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EVALUATION 


The  objective  of  this  effort  was  to  provide  additional  verification  of  the 

monolithic  microcircuit  prediction  models  contained  in  MIL-HDBK-217C,  Notice  1, 

"Reliability  Prediction  of  Electronic  Equipment",  dated  May  1980.  The  study 

evaluated  the  accuracy  of  the  models  through  a  comparison  of  predictions  to  actual 

observed  device  failure  rates  using  data  acquired  since  the  completion  of  the  model 

development  program  in  March  1979.  This  newly  acquired  data  base  encompasses  a 
9 

total  of  39.4  x  10  part  hours  on  digital  microcircuits  including  large  scale  integrated 
devices  (LSI),  memories,  and  linear  devices. 

Special  statistical  techniques  such  as  ratio  plots  were  applied  to  provide  an 
objective  and  unbiased  assessment  of  the  models.  These  ratio  plots  for  the  5 
monolithic  models  in  MIL-HDBK-217C  are  presented  to  show  how  accurately  they 
predict  failure  rates.  The  digital  models  for  both  monolithic  Bipolar  and  MOS  devices 
shows  some  dependence  on  the  complexity  factor  but  overall  the  ratio  plot  shows  that 
the  moving  average  line  passes  through  the  middle  of  the  observed  versus  predicted 
points,  indicating  good  correlation.  The  overall  performance  of  the  Monolithic 
Bipolar  and  MOS  Linear  Devices  model  based  on  the  new  data  proved  satisfactory  and 
showed  some  complexity  factor  dependence.  Only  limited  data  was  available  to 
validate  the  Monolithic  Bipolar  and  MOS  Random  Logic  LSI  and  Microprocessor 
Devices  Models,  however,  but  the  moving  average  in  the  ratio  plots  showed  that  the 
model  is  predicting  failure  rates  somewhat  lower  than  the  actual  observed  data.  The 
Random  Access  Memories  (RAMs)  model  again  showed  strong  complexity  dependence. 

The  data  scatter,  particularly  for  4k  RAMs,  results  in  an  average  line  which  differs 
significantly  from  the  ideal  observed  to  predicted  ratio  of  one.  There  was 
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insufficient  data  to  properly  evaluate  the  Read-Only  and  Programmable  Read-Only 
Memories  Model. 

Overall,  the  microcircuit  failure  rates  predicted  by  the  models  in  the  present 
MIL-HDBK-217C,  Notice  1,  based  on  the  data  collected  in  this  effort  were  verified 
to  be  an  effective  means  for  assessing  the  reliability  of  microelectronic  devices. 
Future  revisions  to  the  failure  rate  models  in  MIL-HDBK-217C  will  consider  the  data 
generated  in  this  effort. 

PETER  F.  MANNO 
Project  Engineer 
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1.  INTRODUCTION 


1.1  Objective.  The  objective  of  this  study  is  to  provide  additional 
verification  of  the  monolithic  microcircuit  prediction  models  originally 
developed  in  RADC-TR-79-97,  "LSI/Microprocessor  Reliability  Prediction 
Model  Development,"  dated  March  1979  and  later  incorporated  into  MIL-HDBK- 
217C,  Notice  1,  "Reliability  Prediction  of  Electronic  Equipment,"  dated 
May  1980.  Notice  1  also  includes  the  revised  digital  SSI/MSI  and  linear 
device  models.  This  study  is  concerned  with  the  evaluation  of  monolithic 
reliability  prediction  model  accuracy  through  a  comparison  of  predictions 
to  actual  observed  device  failure  rates.  This  verification  process 
utilizes  field  failure  rate  information  not  employecHn  the  previous  model 
development  programs. 

1.2  Background.  A  means  of  predicting  failure  rate  is  essential  in 
the  development  and  maintenance  of  electronic  equipments.  Predictions 
performed  as  a  part  of  the  design  stage  provide  an  objective  means  of 
comparing  design  options.  They  also  yield  early  estimates  of  anticipated 
equipment  reliability  which  are  useful  in  life  cycle  cost  studies  and 
forecasting  of  spares  holding  requirements.  Previous  microcircuit 
reliability  prediction  techniques,  such  as  those  presented  in  MIL-HDBK- 
217B,  afforded  reasonably  accurate  predictions  for  a  variety  of  device 
technologies  over  the  low  and  medium  complexity  range.  However,  the  rapid 
evolution  of  microcircuit  technologies  introduced  complex  device 
configurations  which  were  beyond  the  intended  scope  of  those  methods.  The 
extensive  use  of  these  complex  new  technology  devices  in  both  military  and 
commercial  electronic  systems  created  an  urgent  need  for  a  relatively 
simple  yet  accurate  method  of  predicting  their  reliability. 

Such  a  method  was  derived  In  RADC-TR-79-97  "LSI/Microprocessor 
Reliability  Prediction  Model  Development,"  dated  March  1979.  These  models 
improved  prediction  accuracy  without  substantially  increasing  model 


complexity  by  subdividing  each  parameter  into  a  set  of  more  detailed 
parameters.  Thus,  the  reliability  sensitive  attributes  of  a  device  are 
more  adequately  represented. 

To  insure  that  these  models  remain  accurate  and  realistically  reflect 
the  impact  of  emerging  technologies  and  fabrication  techniques,  it  is 
essential  to  monitor  the  correlation  of  reliability  predictions 
(calculated  using  these  mode'ls)  with  observed  field  failure  rates. 

This  report  describes  the  results  of  the  verification  study  for  MIL- 
HDBK-217C,  Notice  1,  Monolithic  Microcircuit  Reliability  Prediction 
Models. 

2.  DATA  COLLECTION  AND  DATA  ANALYSIS  TECHNIQUES 

2.1  Data  Collection.  The  development  of  the  monolithic  microcircuit 
models  presented  in  MIL-HDBK-217C,  Notice  1  were  based  on  the  analysis  of 
over  32  x  109  part  hours  of  reliability  data  including  laboratory  life 
testing,  reliability  demonstration,  checkout,  burn-in  and  field  experience 
data.  In  this  model  development,  the  reliability  data  resources  were 
complemented  by  a  theoretical  analysis  of  pertinent  reliability  consider¬ 
ations  as  suggested  by  the  fruits  of  an  extensive  literature  search.  To 
establish  confidence  in  the  model,  an  additional  set  of  data  (not  used  in 
deriving  the  model)  was  used  to  compare  predicted  to  observed  failure 
rates. 

Since  the  model  was  developed,  additional  reliability  data  have  been 
collected  as  part  of  the  I ITRI/Rel iabi 1 ity  Analysis  Center  (RAC)  opera¬ 
tion.  This  latest  data  encompasses  a  variety  of  device  types  (including 
some  new  technology  devices)  in  a  number  of  different  package  configur¬ 
ations  and  applications  for  a  total  of  39.4  x  109  part  hours.  Thus  a  total 
of  71.4  x  109  part  hours  have  now  been  used  in  deriving  and  validating  the 
model . 
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Since  the  validity  of  failure  rate  prediction  models  can  be  best 
assessed  through  a  comparison  of  predictions  and  reliability  experiences 
in  actual  usage  conditions,  only  field  reliability  data  is  employed  in  this 
validation  study.  All  field  data  acquired  since  the  completion  of  the 
model  development  program  in  March  1979  has  been  utilized  and  is  presented 
in  Appendix  A.  A  summary  of  the  data  is  given  in  Table  1. 

TABLE  1:  SUMMARY  OF  DATA  ENTRIES  EMPLOYED 
IN  MODEL  EVALUATION 


Device  Category 


Number  of  Data  Points 


Digital,  SSI/MSI  4*4 
Digital,  LSI  35 
Memory  97 
Linear  127 
Total  673 


(Note  that  the  number  of  data  entries  in  Appendix  A  is  less  than  673  since 
some  of  the  data  points  are  for  the  same  device  in  identical  conditions. 
Such  data  points  are  combined  into  one  entry.) 


2,2  Data  Analysis  Techniques.  Special  statistical  techniques  have 
been  developed  (or  adapted  from  standard  methods)  to  provide  an  objective 
and  unbiased  assessment  of  the  models.  The  later  stages  of  the  study  were 
largely  concerned  with  developing  a  general  procedure  applicable  to  any 
study  of  this  type.  The  goal  was  to  provide  a  procedure  which  did  not 
oversimplify  the  underlying  statistics  but  at  the  same  time  was  understood 
by  the  layman.  Any  presentation  format  which  was  based  on  engineering 
principles  was  considered  particularly  attractive. 


The  following  techniques  were  used  in  the  study: 


(i)  Logarithmic  Failure  Rate  Ratio  Plot.  One  way  to  assess  the 
performance  of  a  model  is  by  residual  analysis,  i.e.,  the  error  regaining 
after  the  model  has  been  fitted.  We  are  concerned  with  relative  (or 
percentage)  errors,  since  a  10%  error  at  a  low  failure  rate  is  as  serious 
as  a  10%  error  at  very  high  failure  rate.  Any  attempt  to  consider  actual 
error  can  be  seriously  misleading;  hence,  a  type  of  standard  error 
independent  of  the  magnitude  of  the  failure  rate  is  called  for.  This  Is 
consistent  with  the  concept  of  a  multiplicative  model  (as  employed  In  MIL- 
HDBK-217C)  rather  than  the  general  linear  (additive)  model. 

A  further  requirement  is  that  the  skew  in  the  distribution  of  errors 
should  be  zero  so  that  a  predicted  failure  rate  (Xp)  at  twice  the  observed 
failure  rate  (X0)  appears  equally  but  oppositely  as  serious  as  a  Xp  at  half 
the  observed  failure  rate. 

Given  these  two  stipulations  the  remarkable  visuo-spatial  analytic 
abilities  of  the  brain  can  enhance  the  study  in  an  unbiased  fashion.  The 
keyword  here  is  "enhance,"  and  rigorous  statistical  tests  are  also 
required;  these  are  defined  in  later  sections  of  this  report. 

From  here  on  in  this  report  a  predicted  failure  rate  will  be  referred 
to  as  "predicted"  or  as  Xp.  The  corresponding  observed  failure  rate  will 
be  referred  to  as  "observed"  or 

A  logarithmic  plot  of  the  ratio  of  observed  to  predicted  (\>/*p) 
satisfied  both  stipulations  defined  above.  An  example  of  some  hypothet¬ 
ical  data  is  given  in  Figure  1  and  some  real  data  in  Figure  3.  Figure  2 
gives  a  comparison  of  the  various  graphical  methods  to  show  why  the 
logarithmic  residual  ratio  plot  was  used. 

The  hypothetical  data  are  for  three  points,  all  with  X0  «  10,  but  with 
Xp  respectively  at  5,  10,  and  20  failures  per  10®  hours. 

The  real  data  is  a  subset  of  Appendix  A. 
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PREDICTED  FAILURE  RATE 
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FIGURE  1:  RATIO  PLOT 
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VALUE  OF  LOG (A  /A  ) 


(«)  LINEAR:  +  100S  ERROR  APPEARS  MORE  SERIOUS 

For  the  larger  magnitude  \ 


b)  LINEAR  RESIDUAL  RATIO  PLOT: 

4-  100S  ERROR  MAGNITUDE  DEPENDENCE 
ELIMINATED  BUT  HIGHLY  SKEW. 


(c)  LOGARITHMIC  RESIDUAL  RATIO  PLOT: 

+  100S  ERROR  SYMMETRICAL,  EQUALLY  SERIOUS. 


FIGURE  2:  COMPARISON  OF  THE  DIFFERENT  METHODS  OF  DEPICTING  ERROR  IN  PREDICTED  FAILURE  RATE  (x) 
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FIGURE  3:  RATIO  PLOT  VS.  COMPLEXITY 

The  moving  average  is  simply  a  series  of  arithmetic  means  over  certain 
ranges  of  the  horizontal  axis.  In  this  case,  the  range  is  10  gates  on  the 
complexity  axis.  The  resultant  series  of  points  are  joined  for  clarity. 
The  moving  average  highlights  and  smooth's  the  relation  between  the  two 
variables,  in  this  case  log  V\i»  and  complexity. 

Mathematically,  the  principle  of  the  ratio  plot  is  explained  by: 

(log  2  -  log  1)  =  (log  1  -  log  0.5) 

,  2  _  _ 1_ 
and  1  "  0.5 

so  that  a  constant  %  error  is  shown  as  a  constant  distance  from  the  line  of 
perfect  fit. 
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A  perfect  fit  is  found  where  A0  =  Ap  and  hence  where  logio  (xo/xp)  s 
0.  Therefore,  the  goodness  of  fit  of  the  model  is  evaluated  on  a 
symmetrical  scale  about  0,  typically  not  exceeding  +1,  as  shown  in  Figures 
1  and  3.  Note  that  +1  represents  an  order  of  magnitude  in  either 
direction. 

This  plotting  method  is  used  extensively  in  the  analysis.  A  computer 
program  was  written  to  automatically  construct  these  plots  directly  from  a 
data  file. 

(ii)  Significance  Test  for  the  Sample  Mean.  For  actual  field  data, 

the  distribution  of  logio  (W)  is  f0Lind  t0  be  c1ose  to  norrnality  as 
shown  in  Figures  4  and  5.  Figure  4. is  a  straightforward  histogram  for  a 
particular  sec  of  data,  and  Figure  5  shows  the  same  data  on  normal 
probability  paper.  The  Kolmogorov-Smirnov  statistic  (See  Section  2.2(v) 
or  Ref.  3)  concludes  that  there  is  no  significant  departure  from  normality. 

This  normal  attribute  of  the  logarithmic  ratio  plot  is  exploited  in 
deriving  a  statistical  test  to  decide  whether  a  particular  set  of  observa¬ 
tions  is  significantly  different  from  their  associated  predictions.  In 
other  words,  they  could  not  have  arisen  by  chance  at  some  predetermined 
level  of  significance. 

If  the  variance  of  logio  (W*p)  for  a  given  set  of  conditions  is 
then  the  variance  of  the  mean  of  a  set  of  n  such  points  is  o2/n,  where  n  is 
-  the  sample  size.  If  a2  is  estimated  from  a  sample  of  data,  as  s^,  then  the 
variance  of  the  sample  mean  is  ^  .  Since  the  expected  value  cf  logio 
(W  is  0,  and  the  distribution  of  logio  (A0/Ap)  is  approximately  normal 
then 


s/  VTT 


is  distributed  as  Student's  t  distribution  with  (n-2)  degrees  of  freedom. 
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FIGURE  5:  PROBABILITY  PLOT  (NORMAL)  FOR  DATA  USED  IN  FIGURE  4 
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If  t  is  found  to  be  less  than  the  critical  value  (found  in  tables, 
Ref.  4)  at  some  significance  level  then  the  model  is  performing 
satisfactorily  over  the  sample  space,  i.e.,  for  the  set  of  environmental, 

temperature  and  device  conditions  experienced  by  the  data  for  a  given 
technology  type. 

If  t  exceeds  the  critical  value  then  the  deviations  from  the  perfect 
fit  are  not  explained  by  the  laws  of  chance  and  an  improvement  may  be 
required. 

(iii)  Correlation  Matrix.  It  is  required  to  identify  which  factors 
are  causing  fluctuations  in  model  accuracy,  and  one  way  to  do  this  is  to 
correlate  the  residual  with  each  factor  in  turn.  If  it  is  found  that  some 
factor  is  always  large  when  the  residual  is  large,  then  that  factor  may  be 
having  a  deleterious  effect  on  the  model.  In  the  practical  case,  life  is 
never  quite  as  simple  and  we  have  to  be  satisfied  with  identifying  the  most 
likely  factors.  This  is  done  by  means  of  a  matrix  of  correlation 
coefficients,  commonly  referred  to  as  a  correlation  matrix. 

The  correlation  coefficient  is  a  standardized  measure  of  the  extent 
to  which  two  variables  are  dependent  on  one  another.  For  two  variables  x 
and  y,  the  correlation  coefficient  r  is  defined  as: 

_  Covariance  (x,y) 
ax  •  ay 

where  ax  •  ay  is  the  product  of  the  standard  deviations  of  x  and  y.  r 
varies  between  -1  and  +1.  Zero  indicates  no  correlation  and  +1  indicates 
perfect  (positive  or  negative)  correlation. 

Thus  if  there  are  a  number  of  factors  present,  then  each  factor  may  be 
correlated  with  each  factor  to  derive  the  correlation  matrix.  The 
correlations  involving  logio  (A0/Ap)  serve  to  indicate  which  factors  are 
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causing  model  fluctuations.  The  other  correlations  provide  additional 
useful  information  about  the  way  in  which  the  various  factors  interrelate 
with  one  another. 


It  is  net  intuitively  obvious  how  large  r  has  to  be  to  indicate  a 
significant  correlation  and  so  the  sampling  distribution  of  r  is  required. 
Exact  derivation  of  the  sampling  distribution  is  difficult  but  an 
approximation  is  given  by 


which  has  a  t  distribution  (where  n  is  the  number  of  data  pairs).  These 
values  are  tabulated  in  Ref.  4.  For  example,  an  r  value  of  0.3  with  47 
pairs  of  observations  indicates  a  significant  correlation  at  the  5%  level. 
An  r  value  of  0.01  with  the  same  number  of  observations  indicates  no 
significant  correlation  and  hence  r  is  effectively  zero. 


An  annotated  example  of  the  correlation  matrix  is  given  in  Figure  6 
below.  Note  that  the  terms  above  the  diagonal  would  mirror  those  below  and 
are  not  needed  and  therefore  are  not  included. 


VARIABLE  NUMBER 

1  2  3  4  5 

1  1.0  M. - SELF  CORRELATIONS  -  1 


HIGH  POSITIVE 
CORRELATION 


FIGURE  6:  EXAMPLE  OF  A  CORRELATION  MATRIX 

An  objective  assessment  of  which  factors  might  cause  model  fluctu 
ation  is  now  possible  and  was  used  extensively  in  the  analysis. 
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(iv)  Wilcoxon  Rank  Sum  Test.  Where  very  little  information  is 
available  in  a  particular  class  of  data,  it  is  sometimes  not  possible  to 
apply  the  usual  distribution  statistics.  Non-parametr ic  tests  may  be  used 
instead  and  they  generally  consider  the  probability  of  observing  sequences 
of  ranks  under  some  null  hypothesis. 

Wilcoxon 's  rank  sum  test  may  be  used  instead  of  a  parametric  t  test. 
Suppose  two  (small)  sets  of  data  are  gathered  and  it  is  required  to  decide 
whether  or  not  they  are  from  the  same  distribution.  The  two  sets  are 
combined  and  ranked.  The  ranks  for  the  smaller  group  are  then  summed  (R). 
R*  is  then  found  from  R*  =  ni  (n  +  15-R 

where 

ni  =  number  in  smaller  sample 
n-i  =  number  in  larger  sample 
n  =  total  number  (nj  +  n2) 

A  critical  value  of  w  is  then  found  from  tables  (Ref.  6)  given  nj,  n2  and  a 
significance  level  a.  If  either  R  or  R^  exceeds  w  then  the  hypothesis  that 
both  sets  of  data  are  from  the  same  distribution  is  rejected. 

The  theoretical  considerations  in  this  test  are  given  in  Refs.  7  and 

8. 

(v)  Goodness  of  Fit  Testing.  Since  the  sample  sizes  are  often 
quite  small,  the  Kolmogorov-Smirnov  test  is  chosen  for  deciding  how  well 
some  theoretical  distribution  fits  a  set  of  data. 

If  the  observed  cumulative  distribution  at  some  point  x  is  evaluated 
as  F0(x),  and  the  theoretical  cumulative  distribution  at  the  same  point  is 
evaluated  as  Fe(x),  then  D  =  max.  j  F0(x)  -  Fe(x)|  is  the  Kolmogorov- 
Smirnov  statistic.  Tables  of  critical  values  of  D  are  given  in  Ref.  3. 


The  test  may  also  be  used  to  compare  two  sets  of  data  directly  as  an 
alternative  to  Wilccxon's  test.  In  that  case,  one  would  evaluate  D  =  max 
|  FlM  -  F2(x)  I . 

(vi)  Other  Methods. 

General .  General  statistical  techniques  are  implemented  throughout; 
those  described  previously  were  probably  the  most  extensively  used. 
References  are  provided  for  additional  methods  as  necessary.  Mathematics 
was  also  used  as  required,  and,  where  necessary,  formulae  and  derivations 
are  provided. 

Cautionary  Note.  It  is  extremely  import jrit  to  realize  that  when  a 
series  of  separate  statistical  tests  are  performed,  the  significance 
levels  can  be  invalidated.  This  is  because  of  the  fact  that  significant 
correlations  can  arise  by  chance  with  probability  a.  Thus  if  n  tests  are 
carried  out,  no  of  them  are  expected  to  have  arisen  by  chance.  Care  is 
therefore  required  in  providing  an  explanation  for  each  significant 
correlation.  Since  the  significance  level  is  not  used  other  than  to 
identify  specific  factors,  we  are  not  otherwise  concerned  with  this 
phenomenon.  Evaluation  of  exact  significance  is  possible  by  construction 
of  a  multiple  comparison  test  (of  which  analysis  of  variance  and  the 
Studentized  range  are  examples).  The  interpretation  of  correlation 
matrices  and  "multiple"  t-tests  is  tempered  by  this  cautionary  note. 

Hypothesis  Testing.  This  report  assumes  a  rudimentary  knowledge  of 
the  philosophy  of  statistical  hypothesis  testing,  commonly  referred  to  as 
the  Neyman-Pearson  theory.  The  points  of  that  theory  necessary  to 
understanding  this  report  are  therefore  summarized  as  follows. 

First,  a  null  hypothesis  (Hg)  is  chosen;  as  far  as  possible  this 
hypothesis  should  reflect  the  status  quo.  In  many  of  the  tests  in  this 
report,  the  null  hypothesis  is  that  the  model  is  adequate.  It  is  also 
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necessary  to  define  an  alternative  hypothesis  (Hj)  in  advance  of  carrying 
out  the  test.  In  this  report  the  alternative  is  usually  that  the  model  is 
not  adequate.  It  is  also  necessary  to  define  a  significance  level  (a) 
#hich  is  the  acceptable  risk  of  deciding  that  the  model  is  not  adequate, 
utien  in  fact  it  is  adequate.  The  statistical  test  is  then  performed  and 
depending  on  whether  the  result  is  less  than  cr  greater  than  the  tabulated 
critical  value  (Ref.  4)  we  accept  or  reject  Hq  at  that  significance  level. 
If  we  reject  Ho,  we  have  to  accept  Hi-  This  explains  the  use  of  the  words 
"accept"  and  "reject"  in  many  tabulated  tests  in  this  report. 

The  significance  level  a  is  traditionally  taken  as  0.05  (i.e.,  5%). 
Oepending  on  the  particular  study  or  experiment,  one  might  specify  a  smal¬ 
ler  risk  (e.g. ,  156  or  even  0.156)  or  a  greater  risk  (e.g.,  10%).  In  view  of 
the  cautionary  note  above,  a  is  taken  in  one  case,  in  this  report,  to  be 
2*i%.  It  should  be  noted  that  decreasing  a  increases  $  and  vice-versa, 
where  @  is  the  risk  of  accepting  Ho,  when  in  fact  Hi  is  true  (i.e.,  con¬ 
cluding  the  model  is  adequate  when  in  fact  it  is  not  adequate).  Note  that 
the  two  risks  are  analogous  to  "producer"  and  "consumer"  risks  in  a 
manufacturing  process. 

Thus,  the  lower  the  a,  the  more  significant  the  finding.  Strictly  an 
a  should  be  defined  prior  to  starting  the  analysis;  in  this  report,  the 
conclusions  are  based  on  an  a  of  2%%.  It  is  not  orthodox  to  provide  all 
significance  levels  as  has  been  done  in  this  report,  but  they  are  included 
to  provide  further  information. 

The  two  types  of  error,  the  significance  levels,  and  the  potential 
penalties  are  summarized  as  follows: 


Truth/ 

Decision 

»0 

Hj  True 

Accept  k 

0 

Model  adequate  and  we  decide 
it  is  adequate 

Everyone  hippy 

Model  inadequate  and  we  decide 
is  1$  adequate 

Users  find  models  give  bad 
predictions 

Probability  8 

Reject  Hq 

Model  adequate  and  we  decide 
it  is  not  adequate 

Money  watted  redoing  a  good 
model 

Probability  » 

Model  Inadequate  and  we  decide, 
it  is  inadequate 

Everyone  happy 
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In  practice  it  is  never  possible  to  eliminate  these  risks,  a  and  B . 
In  this  study,  it  is  very  unlikely  that  the  conclusions  are  erroneous  since 
they  are  indicated  by  a  series  of  tests  and  logical  inferences  rather  than 
just  one  test  based  on  a  single  sample. 

3.  MODEL  VERIFICATION 

3.1  Data  File.  A  data  file  was  created  consisting  of  the  data  in 
Appendix  1.  The  file  therefore  consists  of  nearly  six  hundred  line 
entries,  each  with  fourteen  variables  entered  in  free  format  and  defined  as 
fol lows: 

TABLE  2:  VARIABLES  USED  IN  DATA  FILE 

Variable 


imber 

Name 

Description 

1 

TECH 

Technology  type,  coded  as  in  Table  3. 

2 

COMP 

Complexity  expressed  as  number  of  gates  or 

bits. 

3 

PKG 

Package  type,  coded  as  in  Table  4. 

4 

N  P  IN 

Number  of  pins. 

5 

SC 

Screen  class,  coded  as  in  Table  5. 

6 

APEN 

Application  environment,  coded  as  in  Table 

6. 

7 

TJ 

Junction  temperature  in  °C. 

8 

HRS 

Total  part  hours. 

9 

#FA1 

Total  number  of  failures. 

10 

OBI 

Lower  80%  confidence  limit  on  observed. 

11 

OB 

Observed  failure  rate  per  10&  hr. 

12 

0B2 

Upper  80%  con, idence  limit  on  observed. 

13 

PRED 

Predicted  failure  rate  per  106  hr. 

14 

LOG 

Logio  (OB/PRED). 

These  codes  are  modified  in  the  individual  technology  correlation  matrices 
and  defined  above  each  matrix. 
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The  codings  used  are  given  in  the  following  four  tables. 


Table  3  Technology  Coding 


Technology  Type 


technology  Code 

CMOS  1 
HTTl  2 
LSTTL  3 
STTL  4 
LTTL  5 
TTL  6 
ECL  7 
Li nears  8 
PMOS  9 
P-MNOS  10 
NMOS  1 1 
MNOS  12 


Table  5  Screen  Coding 


Screen  Class 


Screen  Code 


JB  1 

JB/B-1  2 

B-l  3 

B-2  4 

C-1  5 

C-2  6 

D  7 


Table  4  Package  Coding 


Package  Type 

Package 

Code 

CMDIP 

1 

HDIP 

2 

PDIP 

3 

Can 

4 

HFPK 

5 

EDIP 

6 

SDIP 

7 

CDIP 

8 

CFPK 

9 

MGDIP 

10 

PINL 

11 

EINL 

12 

Table  6 

Application  Environment  Coding 


Environment  Code 


Non -numerical  variables  were  coded  numerically  so  that  numerical 
methods  could  be  approximately  applied.  Where  possible  the  coding 
reflected  the  variable;  for  examp’e,  screen  class  was  coded  from  1  to  8  in 
order  of  decreasing  screening  level.  In  this  way,  approximate 
correlations,  etc.,  could  be  derived  for  non -numerical  data.  Note  that  a 
non-parametric  correlation  coefficient  (such  as  Spearman's  rank 
correlation  coefficient)  might  be  more  accurate  in  some  cases  but  that  we 
are  not  concerned  with  absolute  accuracy  in  such  computations;  an  ordering 
is  sufficient.  This  point  is,  however,  borne  in  mind  when  establishing 
significance  of  apparently  highly  correlated  variables. 

The  data  file  thus  created  allows  computer  programs  to  be  run 
efficiently  for  specified  options. 

3.2  General  Analysis. 

3.2.1  Correlation  and  Goodness  of  Fit  Tests.  The  following  options 
are  first  selected  to  establish  any  major  trends  of  deviations. 

(i)  Correlation  matrix  for  all  variables,  all  data. 

(ii)  Logarithmic  plot  for  all  data,  against  technology  type. 

(iii)  Logarithmic  plot  for  all  data,  against  screen  class. 

(iv)  Logarithmic  plot  for  all  data,  against  environment. 

(i)  The  correlation  matrix  is  given  in  Table  7.  The  critical  values  ' 
of  the  correlation  coefficient  for  the  data  (472  data  points)  were  0.0900 
for  a  significance  (a)  of  5%,  0.1180  for  a  =  1%  and  0.1501  for  <*  =  0.1%. 
The  smaller  the  a,  the  more  significant  the  correlation.  The  values  in  the 
matrix  were  asterisked  accordingly  as  defined  in  the  legend. 

Most  significant  correlations  are  easily  explained  and  the  obvious 
ones  are  not  described  here,  e.g.,  observed  with  complexity.  Some  more 
obscure  and  some  unexpected  correlations  require  explanation. 
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a)  Technology  vs.  complexity  (0.1%)  -  this  correlation  is 
attributable  to  the  coding  of  the  technologies.  Those  with  large  memories 
and  the  like,  such  as  PMOS,  NMOS,  MNOS,  are  assigned  the  higher  code 
values,  so  that  LSI  and  VLSI  technologies  coincide  with  high  code  values. 

b)  Technology  vs.  package  (0.1%)  -  this  is  a  semi-spurious 
correlation  attributable  to  the  fact  that  many  technologies  divide  into 
one  or  two  groups  of  package.  An  example  is  sketched  below  for  LTTL 
devices. 


LOG(A0Ap) 


STRONG  CORRELATION 
DETECTED  ON  THIS  LINE 


A  AND  8  ARE  HYPOTHETICAL  GROUPINGS  OF  THE  OATA 
FIGURE  7:  FORCED  CORRELATION 


For  ease  of  explanation,  this  phenomenon  will  in  future  be  referred  to 
as  the  forced  correlation. 


c)  Technology  vs.  screen  class  (0.1%)  -  similar  to  (a),  the 
particular  sample  of  data  used  for  this  study  included  a  large  number  o* 
digital  parts  of  D-l  and  D  screen  but  there  was  a  higher  proportion  of 
better  quality  parts  in  PMOS,  NMOS,  etc.  From  here  on,  this  type  of 
correlation  is  referred  to  simply  as  a  sample  correlation. 

d)  Technology  vs.  application  environment  (5%)  -  probably  a 
sampling  correlation  but  possibly  also  attributable  to  selective 
employment  of  certain  technologies  in  different  environments,  due  to  the 
unique  characteristics  of  each  technology. 

e)  Technology  vs.  temperature  (0.1%)  -  different  technologies  tend 
to  have  different  operating  junction  temperature  ranges. 

f)  Technology  vs.  number  of  failures  (0.1%)  -  more  data  is 
available  in  certain  technologies,  i.e.,  it  is  a  sampling  correlation. 

g)  Technology  vs.  observed  (0.1%)  -  a  combination  of  sampling  and 
forced  correlation  resulting  in  a  spurious  correlation,  although  it  is 
also  true  that  different  technologies  have  generally  different  failure 
rates.  This  also  explains  the  correlations  of  technology  with  OBI  and  0B2. 

h)  Technology  vs.  predicted  (0.1%)  -  spurious  (see  g  above). 

i)  Package  vs.  number  of  pins  (0.1%)  -  there  is  a  tendency  for 
different  package  types  to  have  certain  ranges  on  numbers  of  pins  but  this 
is  essentially  a  forced  correlation. 

j)  Screen  class,  junction  temperature  and  application  environment 
(all  0.1%)  -  there  is  always  a  strong  correlation  between  these  three 
factors,  since  military  environments  use  military  quality  parts,  and 
temperature  is  a  characteristic  of  environment.  The  orientation  of  their 
inter-relationships  is  sketched  in  Figure  8, 
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SCREEN 

CLASS 


DOTTED  LINES  SHOW  OBSERVED  CORRELATIONS,  THE  PROJECTIONS  OF 
THE  TRUE  RELATION  ONTO  THE  DEFINED  THREE  PLANES 


FIGURE  8:  INTER-RELATIONSHIP  BETWEEN  SCREEN-CLASS,  ENVIRONMENT  AND  TEMPERATURE 
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k)  Number  of  pins  vs.  number  of  hours  (5%)  -  probably  a  sampling 
correlation  but  certainly  spurious.  Similarly  for  hours  vs.  screen  class 
(1%),  which  may  also  be  due  partially  to  more  data  being  available  in  D  and 
D-l  screen  parts.  Also  applies  to  application  environment  and  number  of 
hours  (5%);  in  addition,  certain  environments  have  typically  larger 
sorties  or  missions. 

l)  Junction  temperature  vs.  number  of  hours  ( 0. 1%)  -  more  data  is 
available  at  certain  temperature  ranges. 

m)  Number  of  hours  vs.  observed  failure  rate  (5%)  -  may  indicate  an 
overall  decreasing  hazard  rate  (since  the  correlation  is  negative)  but 
more  specific  matrices  (for  each  technology)  are  required  to  investigate 
fully,  since  this  matrix  represents  all  technologies  combined.  Requires 
further  investigation. 

n)  The  observed  and  predicted  failure  rates  are  correlated  with 
most  factors  as  expected. 

o)  Logio  (\)/*p)  vs.  screen  class  (0.1%)  -  requires  further 
investigation,  the  implication  being  that  the  fit  of  the  model  is  strongly 
dependent  on  screen  class.  It  should  be  remembered  that  screen  class 
appears  to  be  correlated  with  technology  on  the  evidence  of  this  data  and 
this  must  also  be  given  further  consideration. 

P)  Logio  (\)/*p)  vs.  observed  (0.1%)  -  a  requisite  of  the  ratio 
plot,  i,e.,  as  observed  increases,  the  ratio  plot  increases.  Similarly  for 
predicted  with  logio  (*o/*p)>  (0.1%)  -  ratio  plot  decreases  as  predicted 
increases  (correlation  negative). 

All  but  two  of  the  above  correlations  are  explained,  and  these  require 
further  investigation  which  is  described  in  later  stages  of  this  report. 
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(ii)  The  logarithm  ratio  plot  is  first  performed  to  achieve  an 
approximate  indication  of  the  general  performance  of  the  model.  The  first 
ratio  plot  is  run  with  technology  type  as  the  independent  variable.  The 
results  are  shown  in  Figure  9  below. 


FIGURE  9:  RATIO  PLOT,  AGAINST  TECHNOLOGY  TYPE 


This  plot  Indicates  how  well  the  model  performs  for  each  technology  but  it 
should  be  noted  that  some  samples  are  very  small  and  as  such  may  he 
misleading  because  of  sampling  errors. 


The  sample  size  by  technology  is  presented  in  Table  8  below. 


TABLE  8:  SAMPLE  SIZES 


CMOS 

62 

ECL 

26 

HTTL 

23 

Li nears 

115 

38 

PMOS 

15 

31 

P-MNOS 

2 

46 

NMOS 

18 

TTL 

95 

MNOS 

1 

To  decide  which  samples  were  significantly  different  from  the  perfect  fit  a 
t  test  on  each  mean  was  performed  as  defined  in  Section  2(ii).  The 
following  table  gives  all  relevant  statistics  and  decisions  for  each 
technology.  An  approximate  method  was  used  to  evaluate  the  mean  and  S, 
since  this  is  a  preliminary  analysis. 

TABLE  9:  TEST  OF  MODEL  GOODNESS  OF  FIT,  BY  TECHNOLOGY 


Technology 

Sample 
size  (n) 

Mean 

log 

(&olp) 

Standard 

deviation 

t 

Decision 

CMOS 

62 

-0.1739 

0.433 

•3.16 

Reject  (0.2*) 

HTTL 

23 

0.1338 

O.Oui 

1.28 

Accept 

LSTTL 

38 

-0.4230 

0.282 

-9.25 

Reject  (0.2*) 

STTL 

31 

-0.0535 

0.574 

0.52 

Accept 

LTTL 

46 

0.0624 

0.449 

0.94 

Accept 

TTL 

95 

-0.107 

0.449 

-2.32 

Reject  (5X) 

ECL 

26 

-0.048 

0.494 

-2.02 

Reject  (lot) 

LI nears 

115 

-0.161 

0.391 

-0.23 

Accept 

PMOS 

15 

0.098 

0.470 

0.81 

Accept 

P-MNOS 

2 

— 

— 

— 

NMOS 

18 

-0.246 

0.418 

-2.5 

Reject  (5*) 

MNOS 

1 

-,-r 

...  — 

— 
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Thus  the  mean  of  the  samples  for  CMOS  &  LSTTL  technologies  were  found  to 
have  greater  deviations  from  the  perfect  fit  than  chance  would  indicate  at 
the  stated  significance  levels.  This  may  be  due  to  the  model  or  it  may  be 
due  to  some  other  correlated  factor.  This  will  be  assessed  later.  At  this 
point  the  deviation  has  been  noted  and  requires  further  investigation  and 
subsequent  explanation.  Although  it  is  not  usual  practice  to  present  all 
the  significant  levels  (one  normally  defines  a  single  o  in  advance)  they 
are  given  to  provide  additional  Information. 

(ill)  The  ratio  plot  is  repeated  with  screen  class  as  the 
independent  variable.  The  resultant  plot  is  shown  below  in  Figure  10. 


FIGURE  10:  RATIO  PLOT,  AGAINST  SCREEN  CLASS 
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Table  10  below  gives  all  relevant  statistics  and  sample  sizes. 


TABLE  10:  TEST  OF  MODEL  GOODNESS  OF  FIT  BY  SCREEN  CLASS 


Screen  Class 

Sample 
Size  (n) 

Mean 

i°9<yy 

S 

t 

Decision 

JB 

1 

— 

...  ■ 

— 

JB/B-1 

4 

0.483 

0.533 

1.81 

Accept 

B-l 

10 

0.335 

0.433 

2.44 

Reject  (5X) 

B-2 

7 

0.276 

0,458 

1.60 

Reject  [20%) 

C-l 

29 

-0.187 

0.458 

-2.20 

Reject  (5%) 

C-2 

0 

— 

— 

— 

— 

D 

134 

0.107 

0.458 

2.71 

Reject  (IX) 

D-l 

289 

-0.558 

0.416 

-22,8 

Reject  (0.01*) 

Clearly  there  was  insufficient  information  on  some  screen  classes  to  apply 
a  t  test  with  validity.  This  problem  is  addressed  further  .under  the 
detailed  section  on  screen  class  (Section  3.3.6).  A  conclusion  at  this 
stage,  though,  is  that  there  was  no  evidence  to  show  that  the  model  was  not 
performing  satisfactorily  with  respect  to  screen  class,  with  the  notable 
exception  of  class  D  and  D-l  screens.  Failure  rate  predictions  for  D  and 
D-l  screen  classes  deviated  very  significantly  from  the  perfect  fit  for 
this  sample  of  data.  This  required  an  explanation,  which  is  given  later. 

(iv)  The  ratio  plot  is  repeated  with  application  environment  as  the 
independent  variable.  The  resultant  plot  is  shown  in  Figure  11. 
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FIGURE  11:  RATIO  PLOT,  AGAINST  APPLICATION  ENVIRONMENT 
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The  relevant  sample  sizes  and  statistics  are  given  in  Table  11  below 


TABLE  11:  TEST  OF  MODEL  GOODNESS  OF  FIT  BY  APPLICATION  ENVIRONMENT 


Environment 

Sample 
size  (n) 

Mean 

,o910(Vp) 

s 

t 

Decision 

Ground,  Benign 

13 

0.119 

0.568 

0.76 

Accept 

Missile,  Ground, 

Benign 

3 

0.442 

0,467 

1.64 

Accept 

Ground,  Fixed 

20 

0,070 

0.537 

0.58 

Accept 

Ground,  Benign, 
Commercial 

388 

-0.133 

0.620 

-4.24 

Reject  (0.051) 

Airborne,  Unin¬ 
habited  (Fighter) 

31 

0.159 

0.620 

1.43 

Reject  (20X) 

Airborne,  Inhabited 
(Transport) 

12 

0.091 

0.690 

0.46 

Accept 

The  only  significant  departure  from  the  perfect  fit  was  exhibited  by  the 
Ground  Benign,  Commercial  (GBC)  environment.  This  consistently  predicted 
higher  than  observed.  Again  an  explanation  is  required. 

3.2.2  Review  of  General  Analysis.  Combining  the  information  in 
hand  gave  preliminary  information  as  to  where  the  model  accuracy  was 
unsatisfactory. 

Very  poor  model  performance  was  exhibited  by  D-l  screen  class  data,  by 
LSTTL  technology  data,  ana  by  GBC  environment  data.  The  correlation  matrix 
showed  a  correlation  between  screen  class  and  environment;  hence  the 
observations  could  be  from  the  same  cause.  Close  inspection  of  the  data 
confirmed  this  since  all  LSTTL  data  was  GBC/D-1.  To  identify  which  factor 
was  the  cause,  the  GBC  environment,  D  screen  class  data  was  considered  and 
found  not  to  follow  the  GBC/D-1  trend.  The  inference  is,  therefore,  that 
the  screen  class  was  the  cause.  The  inference  is  supported  by  the 
correlation  matrix  where  screen  class  was  identified  as  the  only 
significant  factor.  Strictly  speaking,  an  analysis  of  variance  should  be 


performed  on  0  and  D-l  data  for  two  different  environments  to  fully  confirm 
the  inference;  unfortunately,  not  enough  data  was  available  in  any  other 
environment  for  D  and  D-l  screen  class. 


The  findings  of  this  general  analysis  were  therefore  that  the  "q 
factor  required  re-evaluation  for  the  D-l  screen.  Currently  it  is  assigned 
a  value  of  35,  which  is  too  large.  Whether  this  was  due  to  the  particular 
sample  of  data  is  not  known.  There  is  a  possibility  that  the  parts  were 
burned-in  and  screened  after  procurement  since  this  would  have  the  same 
deleterious  effect  on  the  goodness  of  fit  of  the  model. 


Before  performing  a  detailed  analysis  the  "q  factor  required 
correction  because  the  bad  fit  interfered  with  the  analysis.  It  should  not 
be  inferred  that  a  change  in  MIL-HDBK-217C  is  recommended  or  that  the  same 
effect  would  be  noted  in  all  data.  This  correction  was  effected  by  forcing 

m 

the  mean  of  the  D-l  screen  data  through  the  line  of  perfect  fit. 


Considering 

D-l 

Let  9i 

be 

Let  02 

be 

In  general. 

Let  0-j 

be 

Let  ni 

be 

Let  n2 

be 

In  general, 

Let  Ni 

be 

Let  the  total  sample  size  be  N. 
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i  .e. 


i 

then 


12 

E  n. 


1/N 


(When  dealing  with 
p  from  the  data  in 


is  the  weighted  geometric  mean  of  logio  (x0/Xp). 
ratios,  a  geometric  mean  is  preferred.)  Evaluating 
Table  10  gave  0.558.  Since  tiq  is  a  multiplier  in  the  MIL-HDBK-217C  model 

(Ref.  2),  the  adjustment  is  made  by  finding  puq* 

Hence,  the  adjusted  uq  for  D-l  screen  was  0.558  x  35  ~  19.54 

Strictly  a  least  squares  fit  should  be  used  to  optimise  "Q.  The  weighted 

geometric  mean  technique  will  optimise  only  approximately  but  was  quite 
sufficient  for  the  purposes  of  this  study  and  was  considerably  quicker  in 
synthesis.  The  *q  factor  for  D  data  was  not  adjusted  since  it  did  not  so 
severely  hamper  the  investigation. 

3.3  Detailed  Analysis. 


3.3.1  Data  File  and  Program  Options.  The  data  file  was  updated  to 
include  the  adjusted  ttq  factor  for  D-l  screen  class  devices.  Corresponding 
adjustments  to  logio  (Xo/Xp)  were  made.  A  family  of  correlation  matrices 
erd  ratio  plots  were  run  to  identify  those  factors  causing  model 
fluctuations.  The  data  were  first  separated  into  technologies.  For  two 
technologies  there  was  not  enough  data  to  apply  the  correlation 
matrix/ratio  plot  method  and  these  were  given  special  considerations 
separately.  The  two  technologies  were  P-MNOS  and  MNOS.  Then  for  each  of 
the  other  ten  technologies  the  following  options  were  selected: 
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(i)  A  correlation  matrix  for  each  technology  after  adjustment  of 
*q,  giving  a  total  of  ten  matrices. 

(ii)  Two  ratio  plots  with  complexity  as  the  independent  variable, 
one  plot  'before  adjustment  of  "q  and  one  after  adjustment. 

(iii)  Two  ratio  plots  with  application  environment  as  the 
independent  variable,  before  and  after  adjustment. 

(iv)  Two  ratio  plots  with  screen  class  as  the  independent 
variable,  before  and  after  adjustment. 

(v)  Two  ratio  plots  with  junction  temperature  as  the  independent 
variable,  before  and  after  adjustment. 

Options  (ii)  to  (v)  give  a  total  of  eighty  plots  and  a  number  were  included 
in  this  report.  The  correlation  matrices  are  included  in  Appendix  B  and  a 
summary  of  the  salient  points  is  given  in  Table  12.  The  table  shows  which 
factors  were  correlated  with  logio  (xo/*p)  by  asterisks,  whose  legend  is  as 
before.  In  addition,  a  plus  (+)  indicates  positive  correlation,  a  minus 
(-)  indicates  negative  correlation.'"^/ 

The  positive  correlations  of  logio  (xo/xp)  with  observed  in  all  cases 
and  the  negative  correlations  with  predicted  in  some  cases  was  simply  due 
to  the  method  used,  i.e.,  logio  (*oAp)  was  forced  to  correlate  with  both 
observed  and  predicted. 

The  other  correlations  are  considered  in  detail  in  Sections  3.3.2  to 
3.3.8. 


A  selection  of  ratio  plots,  particularly  those  referenced  in  this 
report,  have  been  provided  in  Appendix  C.  Their  consultation  is  not 
essential  to  understanding  the  text  but  they  considerably  enhance  an 
understanding  of  the  points  made  and  the  data  generally. 
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TABLE  12:  FACTORS  CORRELATED  WITH  MODEL  FIT  (1og1()  *0Ap) 


Tech. 

Complexity 

Package 

Type 

*  Mns 

Screen 

Class 

Application 

Environment 

Junction 

Temp. 

#  of 
Failures 

Observed 

Predicted 

CMOS 

*  • 

*  - 

*  . 

***  . 

***  ♦ 

HTTL 

• 

**  + 

***  ♦ 

L5TTL 

4 

STTL 

*  ♦ 

♦+  „ 

*  + 

**  ♦ 

LTTL 

***  ♦ 

***  4 

+++  m 

**  ♦ 

***  + 

**  . 

TTL 

***  „ 

#  . 

irtrtt  _ 

**♦  4 

ECL 

***  ♦ 

*  . 

Llnears 

*  - 

*  « 

*«  ♦ 

«**  . 

PHOS 

*  ♦ 

. 

NMOS 

*  . 

*  i 

*#«  4 

LEGEND:  *  Correlation  significant  (5%) 

**  Correlation  highly  significant  (1%) 

***  Correlation  very  highly  significant  (0.1%) 

-  Negative  correlation 
+  Positive  correlation 

The  factors  influencing  the  model  performance  are  now  considered  one 
by  one  in  detail.  The  order  in  which  they  are  considered  is  chosen  so  that 
inferences  accumulate  logically.  In  this  way  it  is  hoped  to  provide  a 
readable  account  of  a  complex  decision  process.  Additional  ratio  plots 
were  run  as  necessary  for  specific  investigations,  and  these  are  defined  in 
each  section.  The  relevant  ratio  plots  are  referenced  at  the  end  of  each 
section. 
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3.3.2  Package  Type.  A  ratio  plot  for  all  data  with  package  type  as 
the  independent  variable  was  run.  This  plot  shows  that  there  were  no 
general  problems  with  the  package  complexity  factor  C3. 

The  correlations  of  logio  (Wxp)  package,  noted  for  CMOS,  LTTL 
and  NMOS  are  predominately  sampling  and  forced  correlations.  It  is 
possible  that -the  values  for  C3  in  some  cases  are  not  truly  optimal  for  the 
population  but  there  is  no  evidence  in  this  data  to  reject  the  current 
package  complexity  factor  tables,  wholly  or  partially. 


Ratio  Plot  1 

3.3.3  Number  of  Pins.  The  number  of  pins  affects  both  the  package 
complexity  factor  C3  and  the  estimated  junction  temperature  Tj.  Hence,  any 
fluctuations  in  model  performance  with  number  of  pins  could  affect  both  C3 
and  Tj.  A  ratio  plot  was  run  for  all  data  with  number  of  pins  as  the 
independent  variable.  This  plot  shows  that  generally  there  are  no  serious 
problems  with  the  model  with  respect  to  number  of  pins.  Correlations 
previously  noted  in  TTL  and  NMOS  data  appear  to  be  forced. 


Ratio  Plot  2 

3.3.4  Number  of  Failures.  A  strong  correlation  here  would  indicate 
an  increasing  or  decreasing  hazard  rate.  Although  correlations  are  found 
in  HTTL  and  LTTL  data,  there  is  not  enough  information  to  adequately  assess 
the  hazard  rate.  However,  an  indication  is  possible  and  an  example  is 
given  in  Figure  12  for  TTL  data.  This  graph  shows  how  the  failure  rate 
estimate  typically  varies  with  number  of  failures  per  record  (r);  clearly 
this  effect  is  simply  due  to  the  central  limit  theorem,  (See  Section  4), 
since  the  variability  at  low  r  is  much  greater  than  at  r  in  excess  of  about 
12.  A  running  mean  in  steps  of  5  on  the  r  axis  is  shown  by  a  dotted  line, 
and  a  further  smooth  of  that  line  (using  the  median  of  three)  is  constant 
at  a  value  of  X  which  coincides  almost  exactly  with  the  maximum- likelihood 
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estimator  of  A.  Since  the  final  smooth  Is  extremely  powerful,  net  too  much 
emphasis  should  be  placed  on  its  constancy,  but  it  provides  reasonable  sup* 
port  for  the  exponential  (i.e.,  constant  a)  model,  for  the  data  used  here. 
Not  all  data  sets  are  as  well-behaved  and  some  appear  to  have  qgn -constant 
hazard  rates  initially  but  there  Is  not  enough  data  to  confirm  this. 

Note  that  the  data  for  smaller  r  probably  give  rise  to  the  more 
extreme  points  In  the  ratio  plots,  and  this  Is  confirmed  by  reference  to 
the  correlation  matrices  where  r  is  often  correlated  with  logio  (xo/xp)* 

The  distribution  of  time  to  failure  Is  considered  analytically  In 
Section  4. 


3.3.5  Complexity.  There  are  three  correlations  with  complexity, 
namely  In  STTL,  CMOS  and  linear  technologies.  The  correlation  for  STTL 
data  Is  found  to  be  spurious  since  It  Is  the  result  of  a  couple  of  rogue 
points.  The  remaining  two  correlations  are  noted  in  CMOS  and  linear  device 
data.  Reference  to  the  relevant  ratio  plots  shows  that  there  Is  indeed  a 
definite  although  gentle  slope  in  each  case.  A  moving  average  Is  super¬ 
imposed  by  hand  with  a  continuous  line.  The  trend  Is  emphasized  by  the 
dotted  line  which  Is  a  simple  smooth  of  the  continuous  line.  Both 
technologies  are  seen  to  exhibit  optimistic  predictions  for  small 
complexities  (since  logio  xo/xp  51  °)  and  gradually  move  to  pessimistic 
predictions  at  higher  complexities.  The  perfect  fit  appears  to  be  in  the 
region  of  25  gate  complexity.  It  Is  worthy  of  note  that  the  temperature 
factors  for  both  CMOS  and  linear  devices  (but  no  other  technologies)  are 
estimated  from  the  same  table  In  MIL-HDBK-217C.  While  this  would  not 
directly  explain  the  model  dependence  on  complexity,  there  may  be  a  complex 
relation  between  temperature  and  complexity.  This  Is  quite  feasible  for 
CMOS  data  where  a  simple  correlation  between  temperature  and  complexity  Is 
found  (significant  at  1%).  For  linear  device  data,  however,  such  a 
relation  is  less  likely  with  almost  zero  correlation  between  temperature 
and  complexity. 
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Overall  the  fit  of  the  model  with  respect  to  complexity  Is  good,  and 
although  a  strong  correlation  Is  found  between  the  ratio  plot  and 
complexity,  the  magnitude  of  the  associated  errors  is  small.  Summarizing, 
there  is  high  correlation  with  low  bias.  Any  improvement  to  the  model 
would  be  slight  and  this  would  have  to  be  traded  off  against  the  time 
involved  in  recalculating  the  tables  and  the  possibility  of  degrading  the 
model  in  other  areas  (hereafter  referred  to  as  the  domino  effect). 

If  the  improvement  were  considered  worthwhile  attempting,  the 
complexity  table  (Cl  &  C2)  for  linear  devices  is  independent  of  any  other 
technology  and  therefore  could  be  easily  adjusted.  For  CMOS,  the 
complexity  table  applies  to  all  MOS  technologies;  hence  its  adjustment  is 
not  so  simple  and  would  probably  necessitate  a  break  out  into  separate 
tables  for  each  variation  of  MOS  technology. 


«•  -  Ratio  Plots  3  &  4 

3.3.6  Screen  Class.  Correlations  noted  for  CMOS,  STTL  and  LTTL 
data  are  forced  (CMOS,  LTTL)  or  due  to  rogue  points  (STTL)  and  as  such  do 
not  indicate  a  trend  In  model  goodness  of  fit  with  screen  class.  It  is 
still  of  course  possible  that  individual  screen  class  data  may  not  be 
adequately  modelled.  A  ratio  plot  of  all  data  with  screen  class  as 
independent  variable  was  run.  As  expected,  D-l  data  is  now  well  modelled 
with  very  little  bias,  confirmed  by  a  t  value  of  0.022  (not  significant). 
The  remainder  of  the  screen  classes  are  of  course  unaltered  from  the  fits 
defined  by  the  t  values  of  Section  3.2.1  (iii)  Table  10. 

*q  for  D  screen  class  has  not  been  modified  in  study  since  it  was  not 
as  badly  biased  as  that  for  D-l.  Nonetheless,  a  significant  deviation  from 
the  perfect  fit  is  noted  with  predictions  tending  to  be  optimistic.  Since 
the  majority  of  0  screen  class  components  are  linear  devices,  the  domino 
effect  in  all  other  technologies  would  be  expected  to  be  small.  In  linear 
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devices,  the  effect  of  a  modified  for  D  screen  would  result  In  a 
virtually  perfect  model.  Numerically  the  ideal  value  for  *q  on  the  sample 
data  would  be  in  the  region, of  20. 

Ratio  Plot  5 

3.3.7  Application  Environment.  The  correlations  noted  for  STTL, 
LTTL,  TTL  and  linear  devices  are  either  forced  or  due  to  rogue  points. 
They  do  not  signify  a  general  trend  in  model  performance  with  respect  to 
environment.  The  tendency  for  Ground  Benign,  Commercial  data  to  exhibit 
extremely  pessimistic  predictions  has  been  corrected  by  adjustment  of  the 
"q  for  D-l  screen  parts,  with  which  there  is  very  high  correlation.  The  t 
value  for  GBC  data  is  now  0.021  which  is  not  significantly  different  from 
the  perfect  fit. 

Ratio  Plot  6 

3.3.8  Junction  Temperature.  Negative  correlations  are  noted  for 
CMOS,  LTTL,  TTL  and  1  inears.  The  first  three  are  significant  at  the  0.1X 
level  and  the  fourth  is  significant  at  the  5*  level.  Reference  to  the 
corresponding  ratio  plots  confirms  that  there  is  a  definite  trend  with 
junction  temperature.  There  are  a  number  of  possible  reasons  for  this 
effect  and  it  is  not  possible  to  isolate  a  definite  cause  (or  causes) 
statistically.  Possible  causes  will  be  reviewed.  Reference  to  ratio  plots 
7,  8,  9  and  10  illustrates  the  following  discussion. 

The  first  possibility  is  that  the  temperature  tables  used  to  evaluate 
the  ^  factor  are  in  error.  The  tables  are  derived  from 

*T  =  0.1  exp  [  ”^( 77  +  273)  “  558  )] . ^ 

For  LTTL  and  TTL  data  the  slope  and  location  of  "t  are  apparently 
incorrect.  For  CMOS  and  linear  device  data,  the  slope  only  of  is 
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apparently  incorrect.  This  may  be  at  least  partially  attributable  to 
selective  sampling  by  temperature  on  a  *t  curve  having  an  incorrect  slope. 
This  possibility  is  illustrated  by  the  sketch  below. 


Care  is  required  in  any  adjustment  to  insure  that  the  population  (rather 
than  the  sample)  is  modelled  in  this  respect. 
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The  second  possibility  is  that  the  moo'll  for  estimating  junction 
temperature  may  be  Inaccurate.  This  model  is  given  by: 

Tj  =  Tc  +  Gjc  P 

where 

Tj  =  the  Junction  temperature 

Tc  =  the  case  temperature 

0jC  =  the  junction  to  case  thermal  resistance 

P  *  the  worst  case  power  dissipation 

Tc  in  turn  is  estimated  directly  from  the  environment  according  i>  a 
further  tabulation.  Any  errors  in  the  estimation  of  Tj  would  affect  the 
subsequent  evaluation  of  "t* 

A  final  possibility  is  that  there  is  partial  complexity  dependence  as 
noted  in  Section  3.3.4.  Such  a  temperature /complexity  correlation  is 
found  in  CMOS  data  only  and  is  therefore  considered  unlikely  in  general 
although  it  could  well  be  a  factor  in  the  CMOS  model  alone. 

Summarizing,  a  strong  temperature  dependence  of  logio  is 

found  in  certain  technologies  which  is  due  to  either  one  or  a  combi,  .tion 
of  the  following: 

(i)  The  equation  (1)  may  be  inaccurate,  or  the  data  to  which  it 
was  fitted  may  have  been  biased. 

(11)  The  Tj  estimation  formula  may  be  Inaccurate. 

(ill)  Correlation  with  some  other  factor  such  as  complexity  may 
exist  and  degrade  model  performance. 
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Statistically  there  is  no  means  of  deciding  with  certainty  which  of  these 
possibilities  is  the  cause,  although  the  correlation  matrices  tend  to  rule 
out  (iii).  Considering  (i)  and  equation  (1)  above,  A  is  the  equivalent 
activation  energy  divided  by  Boltzmann's  constant. 

The  equivalent  activation  energy  Eea  is  used  to  show  that  the  failure 
rate  of  a  particular  device  type  exhibits  essentially  the  same  temperature 
dependence  as  a  device  failing  due  to  only  one  failure  mechanism  having  an 
activation  energy  Ea=Eea.  Since  an  activation  energy  Ea  may  only  be 
associated  with  a  specific  mechanism,  when  speaking  of  the  temperature 
dependence  of  failure  rate  of  a  device  failing  due  to  the  cumulative 
effects  of  several  mechanisms,  it  is  reasonable  to  express  the  gross 
temperature  dependence  of  failure  rate  for  that  device  in  terms  of  an 
equivalent  activation  energy  Eea.  It  should  be  understood  that  while  Ea  is 
a  constant,  valid  at  any  temperature,  Eea  will  be  approximately  constant 
only  for  a  limited  temperature  range.  For  many  circumstances,  the  concept 
of  equivalent  activation  energy  provides  a  simple,  convenient  means  of 
expressing  the  temperature  dependence  of  failure  rate  for  a  variety  of 
semiconductor  components  operating  at  "typical"  temperatures. 

It  is  possible  that  the  equivalent  activation  energy  was  inaccurately 
assessed  but  there  is  no  new  information  to  justify  changing  it.  Even  if 
it  were  possible  to  justify  increasing  the  equivalent  activation  energy, 
the  resultant  shift  in  *r  values  would  be  small  and  furthermore  would  not 
correct  the  slope  of  the  n  del  with  respect  to  Tj. 

This  is  illustrated  in  Table  13  which  gives  a  comparison  for  LTTL  data 
between  the  current  model  and  the  model  with  an  equivalent  activation 
energy  increased  by  0.05  eV.  The  record  number  refers  to  the  data  line  in 
Appendix  1. 
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TABLE  13:  LTTL  OATA  WITH  OIFFERENT  ACTIVATION  ENERGY  (E*J  ASSUMPTION 

Co 


Record 

1 

Complexity 

Screen 

Environment 

Current 

Prediction 

Prediction  with 
Increased  E... 

C» 

16 

2 

0 

AIT 

0.320 

0.326 

17 

2 

0-1 

G8C 

0.112 

0.113 

35 

3 

0 

AIT 

0.330 

0.336 

36 

3 

0-1 

SSC 

0.112 

0.117 

53 

4 

0 

AIT 

0.340 

0.340 

54 

4 

0-1 

G8C 

0.112 

0.113 

55 

4 

U-i 

rt 

0.117 

0.119 

72 

5 

0-1 

tl 

0.117 

a  e  a  a 

\J .  \C\J 

86 

6 

0-1 

II 

0.117 

0.115 

87 

5 

0-1 

l» 

0.123 

0.122 

104 

8 

0-1 

II 

0.123 

0.121 

105 

8 

0-1 

H 

0.128 

0.129 

117 

10 

0-1 

H 

0.134 

0.137 

126 

12 

0 

AIT 

0.360 

0.367 

127 

12 

0-1 

GBC 

0.123 

0.121 

128 

12 

0-1 

II 

0.134 

0.133 

139 

14 

0-1 

II 

0.134 

0.138 

140 

14 

0-1 

It 

0.173 

0.162 

146 

15 

0-1 

H 

0.140 

0.143 

154 

16 

0-1 

N 

0.162 

0.163 

165 

17 

0-1 

.11 

0.162 

0.167 

172 

18 

0-1 

M 

0.162 

0.169 

179 

19 

0-1 

n 

0.167 

0.172 

185 

20 

0-1 

n 

0.154 

0.164 

186 

20 

0-1 

it 

0.184 

0.191 

136 

24 

0-1 

H 

0.201 

0.216 

201 

25 

0 

AIT 

0.780 

0.677 

202 

25 

0-1 

G8C 

0.151 

0.152 

203 

25 

0-1 

II 

0.173 

0.179 

209 

27 

0-1 

M 

0.179 

0.181 

216 

30 

0-1 

M 

0.179 

0.186 

223 

33 

0-1 

•1 

0-179 

0.184 

230 

36 

0-1 

II 

0.184 

0.196 

238 

37 

0-1 

•1 

0.162 

0.109 

240 

38 

0-1 

H 

0.201 

0.209 

246 

40 

0-1 

II 

0,201 

0.211 

258 

45 

0-1 

» 

0.195 

0.204 

266 

48 

0-1 

•1 

0.184 

0.188 

272 

50 

0-1 

II 

0.201. 

0.209 

275 

51 

0-1 

II 

3.195 

0.201 

282 

54 

0-1 

II 

0.207 

0.212 

295 

59 

0-1 

•1 

0.218 

0.231 

298 

50 

0-1 

N 

0.313 

0.327 

307 

65 

0-1 

II 

0.218 

0.230 

371 

16 

0-1 

H 

0.212 

0.244 

381 

64 

0-1 

II 

0.318 

0.347 

It  is  easy  to  explain  mathematically  the  table  results  by  considering  the 
effect  of  on  the  prediction.  This  is  derived  analytically  below  to  show 
how  a  change  in  1Tf  can  have  a  small  effect  on  the  overall  model,  numeri¬ 
cally. 
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The  prediction  model  is: 

Ap  =  "Q  [Cl  "y  "V  +  (C2  +  C3)  *e]  (Ref.  2) 

where  _ 

Ap  =  the  device  failure  rate  per  106  hours 
^  =  the  quality  factor 

*y  =  the  temperature  acceleration  factor 

*V  =  the  voltage  derating  stress  factor 

"E  =  the  application  environment  factor 

Ci  and  C2  =  circuit  complexity  factors 

C3  =  the  package  complexity  factor 

\  =  the  device  production  learning  factor 

For  the  LTTL  data  used*  \  =  1  and  *v  =  1. 

Hence,  xp  *  "q  [ci  *y  +  (C2  +  C3)  \] 

If  Ap  is  to  be  adjusted  by  a  factor  of  C,  to  Apl  by  adjusting  *y  to  "yl. 

Ap1  =  ttq  ci  ttt1  +  (C2  +  C3)  *q 
Putting  "q  Ci  =  A  and  (C2  +  C3)  *e  "Q  =  8 


Then  Apl 

s 

A  ttjI  +  B 

and  Ap 

= 

A  *y  +  B 

but  Apl 

a 

C'P 

so  A  *[•! 

+  B 

=  C{A  ^y  +  B) 

"T1 

- 

B(C-l) 

C  *y  +  “a 

which  gives  a  simple  means  of  calculating  11  yl  given  C. 
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If  we  assume  for  a  first  order  approximation  that  A  and  B  are  of  the 
same  order,  then 

V  —  C  +  (C-l) 

So 

¥  *  c  ("r  +  1)  -  1  . (2) 

Hence  a  5035  increase  in  "y  will  only  induce  a  25%  increase  in  xp.  This 
approximation  was  used  in  quickly  assessing  various  options  for  *y 
adjustment.  It  was  found  to  give  very  good  approximations. 

Hence,  the.  small  change  in  the  predicted  values  in  Table  13  are 
explained,  and  a  simple  formula  for  assessing  any  other  proposed  options  on 
*T  adjustment  is  derived. 


Returning  to^the  temperature  model,  the  second  term  in  the  brackets  of 
equation  (1)  is  Jgg  and  this  is  simply  a  standardization  of  250C  which  has 
no  effect  on  model  accuracy.  It  Is  possible  that  the  premultiplier  of  0.1 
is  in  error;  this  could  only  be  assessed  by  a  regression  analysis. 

The  first  bracketed  term  is  l/(Tj  +  273).  Given  that  the  ratio  plot 
is  of  negative  gradient,  then  the  model  gradient  is  too  high. 

Equation  (1)  gives  *y  s  0.1  exp 

Substituting  x  =  -A  (y — —  gyj 

'  j 

*T  =  0.1ex 


Differentiating  to  find  the  slope  expression,  at  x 

du  i 


"T 
IT 


=  O.le 


Note  that  decreasing  either  the  premultiplier  or  the  exponent  (or  a 
combination)  will  have  the  desired  effect  on  the  slope. 
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(11)  Tj  is 

estimated  from  the  following  expression: 

Tj 

=  Tc  +  OjcP 

where 

TC 

=  case  temperature 

0jc 

=  junction  to  case  thermal  resistance 

p 

=  worst  case  power  dissipation 

Tc  is  itself  estimated  directly  from  environment  as  below: 


'Environment 

[Tj 

fiB 

nr — 
aIT 

rijrirar 

:  i 

auf 

,  TC(°C) 

H 

35 

55 

65 

95 

0JC  is  itself  estimated  directly  from  package  type  and  number  of  pins. 

Clearly  any  inaccuracy  in  Tj  estimation  would  change  the  slope  and  position 
of  the  predicted  model. 

It  is  unlikely  that  such  a  strong  temperature  dependence  as  shown  in  the 
ratio  plots  would  have  been  left  in  any  model  constructed  by  least  squares 
regression  analysis.  For  this  reason  it  is  suspected  (though  not  proved) 
that  the  errors  are  due  to  the  exponent  In  equation  (1)  rather  than  the 
premultiplier.  Any  such  exponent  error  is  most  'Mkely  to  be  due  to  the 
method  of  junction  temperature  estimation,  as  shown  earlier.  The  severity 
of  inaccuracy  in  the  model  due  to  temperature  and  subsequent  decisions  as 
to  adjustment  of  "j  values  is  considered  later,  for  each  technology 
separately. 


Ratio  Plots  7,  8,  9  &  10 

3.3.9  Special  Considerations.  Some  factors  are  not  considered  in 
the  methods  so  far  used,  either  because  of  a  lack  of  data  or  because  their 
effect  is  too  small  to  be  detectable. 
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(a)  Programming  Technique  Factor  ^pj.  For  many  programming 
technologies,  ^pt  is  1.0  and  the  implication  in  such  cases  is  that  the  mode 
of  programming  has  no  effect.  There  is  not  enough  comparative  data  to 
check  this  value  of  ^pt«  Although  the  same  problem  exists  for  all  the 
data,  where  ^pf  is  not  1.0  it  is  possible  to  evaluate  the  effect  on  the 
overall  failure  rate.  For  some  data  on  device  53000,  upt  for  NiCr 
programming  is  1.08  and  hence  adds  4.3%  to  the  prediction.  For  the  C2708 
EPROM  the  programming  factor  for  UV  eraseables  is  1.56  and  adds  53.4%  to 
the  prediction.  The  large  difference  is  due  to  the  possibility  of 
accidental  erasure  and  the  relative  newness  of  the  technology.  In  view  of 
the  shortage  of  relevant  comparative  data  it  has  to  be  concluded  that  there 
is  no  evidence  to  dispute  the  current  ^pt  factors.  All  that  can  be  said  is 
that  upt  appears  to  reflect  the  expected  trends. 

(b)  Static/Dynamic  RAMS.  The  data  collected  is  limited,  but  a  few 
data  points  allow  direct  comparison  between  static  and  dynamic  RAMS. 
Parametric  statistical  tests  are  not  valid  on  this  amount  of  data  with 
fourteen  failure  rate  estimates,  five  for  static  and  nine  for  dynamic.  For 
both  IK  data  and  4K  data,  Wilcoxon's  rank  sum  statistic  shows  that  there  is 
no  signficant  difference  between  static  and  dynamic  failure  rates.  The 
complexity  factors  reflecting  static  and  dynamic  failure  rate  are  so  small 
as  to  be  undetectable  with  the  amounts  of  data  available  to  this  study. 
Therefore,  no  significant  difference  is  expected.  Although  the  actual 
numerical  values  of  the  static/dynamic  factors  cannot  be  verified,  there 
is  no  evidence  to  reject  their  validity. 

(c)  PMOS  and  NMOS  Technologies.  Because  of  a  worse  than  general  lack 
of  data,  these  two  technologies  are  considered  separately  as  follows.  NMOS 
predictions  are  consistently  pessimistic  as  shown  in  ratio  plot  11.  Part 
of  this  bias  is  certainly  due  to  the  majority  of  the  parts  being  of  D 
screen  class,  but  this  does  not  explain  all  the  bias.  It  is  quite  possible 
that  NMOS  devices  are  not  yet  adequately  modelled  and  this  will  be  a 
function  of  complexity  (consistently  high  in  NMOS  devices).  A  learning 


curve  in  production  may  also  be  indicated  to  a  greater  degree  than  was 
modelled.  Whatever  the  reasons,  the  data  are  inconclusive  and  a  more 
reliable  model  is  not  possible  without  more  data.  To  a  lesser  extent,  the 
PMOS  models  are  not  yet  adequate  but  here  the  bias  is  the  other  way 
(optimistic),  and  the  bias  is  not  so  high  as  for  NMOS  nor  is  it  so 
significant.  Although  special  efforts  were  made,  not  enough  data  was 
available  to  evaluate  the  P-MNOS  and  MNOS  models. 


3.4  Model  Evaluation.  Since  the  model  performance  varies  with 
technology,  the  model  for  each  technology  is  considered  in  this  section  in 
the  light  of  the  inferences  made  so  far. 

The  t  -  statistic  for  the  mean  logio  (X0/Xp)  }S  re-evaluated  with 
adjusted  to  19.5  for  D-l  screen  class  data.  Table  14  summarizes  the 
results.  The  final  column  gives  a  set  of  possible  decisions  and  evaluates 
their  significance  levels,  a.  These  calculations  are  exact,  and  the 
earlier  approximation  method  is  not  employed  here.  The  goodness  of  fit  is 
illustrated  in  ratio  plot  11. 


TABLE  14:  TEST  OF  MODEL  GOODNESS  OF  FIT  BY  TECHNOLOGY.  irQ  ADJUSTED 


n 

Mean  log10  (XQ/Xp) 

s 

t 

Decision 

CMOS 

62 

-0.022 

O'.  413 

-0.419 

Accept 

HTTL 

23 

0.183 

0.420 

2.090 

Reject  5X 

LSTTL 

38 

-0.100 

0.319 

-0.319 

Reject  0.1X 

STTL 

31 

0.152 

0.451 

1.874 

Reject  1QX 

LTTL 

46 

0.210 

0.422 

3.370 

Reject  0.2X 

TTL 

95 

0.043 

0.431 

0.969 

Accept 

ECL 

26 

0.084 

0.421 

1.015 

Accept 

Li  nears 

115 

-0.053 

0.376 

-1.512 

Reject  20X 

PMOS 

15 

0.238 

0.359 

2.568 

Reject  5X 

P-MNOS 

2 

— 

--- 

Accept 

NMOS 

18 

-0.288 

0.450 

-2. 700 

Reject  2% 

MNOS 

1 

... 

Accept 
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For  those  technologies  showing  any  significant  overall  departure  from  the 
perfect  fit,  by  this  test  {significant  being  taken  as  a  =  2%%)  the  results 
are  summarized  as  follows: 

LTTL  high  bias  and  highly  significant 

LSTTL  high  bias  and  highly  significant 

NMOS  high  bias,  significant 

All  others  have  insignificant,  medium  to  low  bias. 

The  LTTL  bias  is  found  to  be  temperature  correlated,  and  there  are 
other  factors  considered  to  be  less  influential  as  defined  earlier  in  the 
report.  The  LSTTL  with  consistent  high  bias  is  found  to  be  otherwise 
uncorrelated  with  the  factors  in  the  model.  This  could  indicate  an 
inaccurate  model  or  simply  a  biased  sample. 

The  overall  error  (and  hence  the  t  -  statistic  evaluated)  may  be 
sample  dependent  and  this  at  least  partially  accounts  for  LTTL  exhibiting 
high  bias.  LTTL  data  is  all  sampled  between  estimated  junction 
temperatures  of  30OC  and  60OC.  Because  of  the  slope  of  the  curve,  a  more 
fully  represented  temperature  sample  would  exhibit  considerably  less  bias. 
This  was  further  illustrated  in  the  sketch  of  Figure  13.  Such  sampling 
error  should  be  standardized,  or  at  least  acknowledged,  in  any  model 
adjustment. 

If  the  temperature  factor  is  in  some  way  the  major  cause  (and  the 
evidence  for  this  is  strong)  then  a  "reshuffle"  of  "y  tables  for  the 
technologies  worst  affected  is  not  recommended,  since  the  slope  with 
respect  to  Tj  would  remain  the  same.  The  required  *y  adjustments  may  be 
quickly  estimated  from  equation  (2),  i.e., 

V  -  C  (*r  +  1)  -  1 
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although  strictly  a  least  squares  analysis  should  be  performed  to 
optimize. 

The  penalties  would  be  possible  domino  effects. 

4.  DISTRIBUTION  OF  TIME  TO  FAILURE 

Information  on  the  time  at  which  each  failure  occurred  Is  not  often 
available.  Most  data  is  in  the  form  of  a  certain  number  of  failures  In  a 
certain  time.  Consequently  the  distribution  of  time  to  failure  (TTF)  is 
very  difficult  to  assess.  It  should,  however,  be  considered  in  any 
evaluation  of  MIL-HDBK-217C,  since  the  models  therein  assume  an 
exponential  distribution  by  virtue  of  the  constant  failure  rate 
assumption. 

The  only  way  to  tackle  this  problem  is  to  set  up  some  null  hypothesis 
ana  review  it  in  the  light  of  the  data.  Hence,  we  set  up  the  null 
hypothesis  that  the  data  is  exponential  (against  the  alternative  that  it  is 
not). 


Under  the  null  hypothesis,  the  TTF  distribution  is  f(t)  =  Xe~xt 


where 

x  *  the  failure  rate 

t  *  time  in  part  hours 


therefore  the  distribution  of  time  to  rth  failure  is  straightforward  to 
derive  and  is  given  by 


a-xt  .r  ..r-1 
g(t)  =  * - 


where  Jr" represents  the  gamma  function. 
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Since  r  itself  has  a  distribution,  the  distribution  of  the  type  of  data 
used  in  this  study  (see  Appendix  A)  is  given  by  a  joint  density  function 
involving  t  and  r.  The  largest  group  of  data  (TTL,  GBC,  D-l)  was  evaluated 
using  a  Monte  Carlo  simulation.  The  program  simulated  the  joint  density 
function  and  gave  a  Kolmogorov-Smirnov  (K-S)  statistic  for  the  data,  under 
the  null  hypothesis. 

For  the  TTL,  GBC,  D-l  data,  the  K-S  statistic  with  30  degrees  of 
freedom  was  found  to  be  0*15,  which  is  found  to  be  not  significant.  Hence 
it  is  concluded  that  the  exponential  assumption  is  not  rejected  by  the  data 
available.  A  fuller  description  of  the  simulation  and  statistical  theory 
is  given  in  Ref  5. 

5.  DATA  SHORTCOMINGS 

A  major  problem  in  constructing  statistical  models  is  always  the  lack 
of  adequate  data.  The  military  data  collection  system  can  readily  supply 
maintenance  data  in  large  quantities,  but  obtaining  such  data  for  a 
particular  equipment  or  component  over  a  large  period  of  time  (typically, 
in  excess  of  eighteen  months)  is  difficult.  In  addition,  in  many  cases  the 
data  does  not  reflect  the  quantity  of  parts  replaced  on  printed  circuit 
boards,  neither  does  it  identify  those  parts.  Hence,  more  depot 
maintenance  data  would  be  invaluable  (as  opposed  to  line  and  shop 
maintenance  data).  Another  serious  shortcoming  is  the  lack  of  recorded 
operating  time.  Maintenance  personnel  are  given  provision  on  the 
appropriate  forms  to  record  operating  time  but  are  not  required  to  fill 
them  in  (by  directive).  Thus,  operating  times  have  to  be  derived  by  tracing 
the  using  commands.  Recent  changes  to  the  Navy  system  augur  well  for  future 
work. 
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models  are  deficient  are  identified  and  quantified.  Possible  causes  are 
reviewed  and  the  most  likely  causal  factors  identified.  Where  positive 
inferences  are  possible,  a  range  of  statistical  methods  are  used  to  give  an 
unbiased  assessment.  The  underlying  distribution  of  time  to  failure  is 
investigated  since  MIL-HDBK-217C  assumes  a  constant  failure  rate  model, 
and  this,  if  not  vindicated,  could  induce  considerable  error  into  the 
predicted  failure  rate.  Results  suggest  that  no  great  error  will  accrue 
from  such  an  assumption  although  it  is  not  always  strictly  valid. 

The  statistical  methods  developed  for  this  study  may  be  used  for 
future  model  evaluation  whenever  an  unbiased  assessment  is  required.  The 
correlation  matrix/ratio  plot  method  may  be  used  iteratively  to  construct 
an  optimal  model  but  least  squares  regression  analysis  is  preferred.  The 
ratio  plot  method  allows  empirical  confidence  intervals  on  predicted 
failure  rates  to  be  readily  evaluated. 

7.  RECOMMENDATIONS  AND  CONCLUSIONS 

The  degree  of  acceptable  error  in  MIL-HDBK-217C  models  has  to  be 
defined.  Once  this  is  done,  the  areas  for  improvement  are  discussed  in  this 
report.  Depending  on  the  accuracy  required,  the  outstanding  areas  of  poor 
model  performance  as  identified  by  this  study  are: 

(a)  "q  for  D-l  screen  class.  Note  that  this  could  well  be  due  to  the 
particular  sample  taken  and  inspection  confirmed  that  the  components  had 
undergone  in-house  screening.  Additional  information  probably  in  the  form 
of  more  data  from  diverse  sources  is  desirable.  At  the  time  of  writing  it 
is  understood  that  MIL-HDBK-217D  will  allow  the  use  of  a  D  factor  for 
plastic  encapsulated  devices  which  undergo  burn-in  and  temperature  cycling 
and  a  high  temperature  continuity  test. 

(b)  *q  for  D  screen  class.  The  perfect  fit  would  be  realized  by  a  ^ 
of  about  20  which  is  not  drastically  different  from  the  current  value  of 
17.5. 
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(c)  ^  for  CMOS,  LTTL,  TTL  and  linear  device  technology  Is  found  to 
be  correlated  with  poor  model  fit  although  only  LTTL  shows  significant 
bias.  For  LTTL  the  bias  is  large  but  partially  sample  dependent.  This 
dependency  of  model  performance  on  ^  is  most  probably  due  to  the  method  of 
estimating  junction  temperature  although  other  contributing  factors  are 
not  ruled  out  (as  discussed  in  the  main  report). 

(d)  LSTTL  and  NMOS  models.  The  poor  fit  observed  in  these 
technologies  is  not  apparently  correlated  with  any  particular  factor  or 
factors.  For  NMOS  there  is  clearly  not  enough  data  to  adequately  define  a 
model,  although  what  data  there  Is  statistically  rejects  the  current 
model.  For  LSTTL  the  model  is  very  poor;  there  is  a  possibility  that  this 
is  due  to  the  sample  collected  but  there  is  no  evidence  to  support  such  a 
possibility. 

The  microelectronic  device  section  in  MIL-HDBK-217C  is  divided  into 
the  following  broad  categories  and  it  would  be  as  well  to  summarize  the 
conclusions  in  that  format  also. 

(i)  Monolithic  Bipolar  &  MOS  Digital  (SSI/MSI).  The  performance  of 
this  model  is  illustrated  in  ratio  plot  #12.  Overall  there  is  very  little 
bias  although  some  complexity  dependence  is  indicated  with  logio  (\j/*p) 
decreasing  as  complexity  increases  up  to  about  70  gates. 

( i 1 )  Monolithic  Bipolar  and  MOS  Linear  Devices.  The  overall 
performance  is  satisfactory  but  again  there  is  some  complexity  dependence, 
as  illustrated  by  ratio  plot  #4. 

(iii)  Monolithic  Bipolar  and  MOS  Random  Logic  LSI  and  Microprocessor 
Devices.  There  is  less  data  available  to  validate  this  model  but  the 
results  do  show  negligible  bias  with  ten  points  above  and  ten  points  below 
the  line  of  perfect  fit.  The  data  are  plotted  in  ratio  plot  #13. 
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(iv)  Random  Access  Memories  (RAMs).  Again,  a  clear  complexity 
dependence  is  illustrated  (ratio  plot  #14).  More  specifically  it  would 
appear  that  4K  RAMs  are  not  adequately  modelled. 

(v)  Read-Only  Memories  (ROMs)  and  Programmable  Read-Only  Memories 
(PROMs).  Ratio  plot  #15  shows  that  there  . is  not  enough  data  to  properly 
evaluate  the  ROM  and  PROM  model. 

It  may  be  desirable  to  construct  confidence  intervals  on  a  prediction 
based  on  MIL-HDBK-217C.  At  the  component  level  this  can  be  appreciated  by 
looking  at  the  relevant  ratio  plot  and  observing  the  scatter.  Numerically, 
it  is  possible  to  estimate  the  variance  in  the  data  since  it  is  normally 
distributed  about  the  line  of  perfect  fit.  This  then  allows  a  confidence 
interval  on  the  mean  to  be  set  up  in  the  usual  way  and  a  simple 
transformation  will  allow  an  interval  on  the  predicted  failure  rate.  An 
exact  method  for  calculating  confidence  intervals  has  not  been  devised  but 
may  be  the  subject  of  future  work. 

At  the  system  level,  clearly  the  central  limit  theorem  will  dictate 
that  confidence  in  predictions  increases  with  the  number  of  components  in 
the  system.  Again  this  has  not  been  evaluated  but  s,.ay  be  the  subject  of 
future  work. 

The  most  widely  voiced  criticisms  of  MIL-HDBK-217C  appear  to  be  in 
connection  with  its  ever-increasing  complexity  and  with  errors  of 

I 

estimation  in  MTBF's,  logistics  requirements,  etc.  These  two  complaints 
are  approximately  equal  and  opposite  but  do  not  cancel  out.  However,  both 
are  quite  valid  and  as  such  the  following  points  are  emphasized. 

The  prediction  models  provide  an  accurate  means  of  assessing  relative 
failure  rates.  These  are  of  prime  use  in  reviewing  options  and  costing 
trade-offs.  If  absolute  failure  rate  (or  MTBT)  is  required,  then  other 
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factors  should  be  taken  into  account;  in  particular,  the  variability  in  the 
data  should  be  included  in  the  prediction.  The  most  popular  of  the 
available  means  of  expressing  the  variability  in  a  parameter  estimate  is 
some  form  of  confidence  interval.  These  may  be  constructed  either  from  an 
assumed  distribution  or  the  data  directly.  Estimation  from  distribution 
theory  is  not  entirely  satisfactory  in  view  of  the  variability  found  in 
this  study.  It  is  recommended  that  future  editions  of  MIL-HDBK-217C  should 
include  some  form  of  confidence  interval  estimation  procedure,  based  on 
the  data. 

When  the  prediction  model  is  found  to  be  too  complex  then  MIL-HDBK- 
217C,  Part  III  is  included  as  an  alternative.  This  method  is  of  course  not 
as  accurate.  It  is  probably  true  that  statistical  theory  would  not  fit  as 
many  parameters  as  are  fitted  in  MIL-HDBK-217C,  nor  would  it  regress  on  a 
set  of  variables  which  are  themselves  correlated  (in  practice,  some 
dependence  is  inevitable).  However,  where  two  such  variables  (e.g., 
junction  temperature  and  application  environment)  are  found  to  both  have 
significant  effects  there  is  really  little  option  given  the  user  needs. 
Additionally  a  priori  knowledge  on  influential  factors  was  available.  It 
could  be  worthwhile  to  investigate  a  simpler  model  and  compare  its  accuracy 
with  MIL-HDBK-217C  Part  II  and  Part  III  models. 

Clearly  the  major  problem,  as  with  many  statistical  models,  is  a  lack 
of  adequate  data.  Many  industries  and  manufacturers  are  unable  or 
reluctant  to  provide  reliability  data.  Government  agencies  and  the 
military,  while  co-operating  with  data  collection  efforts,  are  often 
hampered  by  inadequacies  of  the  current  maintenance  data  collection  system 
or  lack  of  clear  directive  with  respect  to  reliability  data. 

Although  there  are  many  problems  in  adequate  estimation  of 
reliability,  the  results  of  this  study  provide  a  clear  analysis  of  the 
performance  of  the  predictive  models  of  MIL-HDBK-217C.  The  models 
generally  stand  up  well  to  recent  data  in  the  categories  for  which  data  is 
available. 
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APPENDIX  B 


CORRELATION  MATRICES 


CMOS 


v«r. 

LASEL 

:.eaj: 

STC-DEV 

::i:r 

t 

CC7P 

31 • 725c 

22.5637 

t.OCCOE  00 

c.CCOCC  Cl 

2 

PKG 

2.3645 

0.4999 

2.CCCCE  CO 

3.0CC0E  OC 

i 

::pin 

15.5606 

1.4C9G 

1.4CC0E  Cl 

2.4CCCE  01 

l 

sc 

7.5645 

0.4999 

7.CCC0E  OC 

S.CCOOE  CC 

5 

ape:.' 

3.C226 

0.3851 

3.CCCCE  CO 

4.C00CE  OC 

6 

tj 

45.4355 

5.5149 

4.1CC0E  01 

6.5CCCE  Cl 

7 

iJ.S 

40.4956 

65.4009 

1.242CE  CC 

S.7097E  02 

S 

0FAI 

9.1290 

20.5636. 

t.OOCCE  CC 

1.40C0C  C2 

s 

CEl 

0.1934 

0.2224 

1.GC0GE-U2 

1.23CCC  CO 

1C 

OE 

C.3445 

0.3729 

3.CCCCE-02 

2.4CCCE  CO 

a 

OS2 

0.6230 

0.6798 

8.CCCCE-C2 

4.4ZCCE  00 

12 

PF.ED 

0.2629 

0.1624* 

1.2CCCE-01 

1.02000  00 

13 

LOG 

-0.0215 

0.4135 

-1.1461E  CO 

S.6171E-C1 

cckr.  u.mz 


ccr.r.cuTio.*: ; 

I1ATP.IX 

* 

(  11 

(  21 

(  3) 

t  41 

(  51 

(  61 

(  71 

(  8J 

(  91 

l  101 

t  lU 

(  121 

(  131 

(  11 

l.CCO 

t  21 

0.C92 

1.000 

£  31 

(  *.j 

C.443 

-0.124 

1.000 

C.CS2 

l.OCO 

-C. 124 

1.000 

t  5J 

• 

C.C41 

0.529 

0.042 

0.529 

l.OCO 

(  6J 

0.4C5 

0.183 

-0.031 

0.183 

O.ICO 

l.CCO 

t  71 

-0.249 

0.224 

-0.237 

0.224 

C.139 

-C.C74 

l.CCO 

t  «1 

-0.252 

C.161 

-0.229 

0.181 

C.  Ill 

-0*097 

C.S63 

l.CCO 

l  91 

-C.06S 

-0.250 

0.243 

-0.250 

•0.261 

-C.1C2 

-O.C36- 

C.C9F 

l.COC 

[10] 

-O.C58 

-0.261 

0.248 

-0.261 

-0.297 

-O.C93 

-0.156 

-0.034 

0.945 

l.CCO 

till 

-C.C57 

-0.24C 

C.217 

-0.240 

-0.265 

-O.C92 

•0.220 

-0.120 

0.S1C 

0.955 

'l.CCO 

(12) 

C.424 

0.242 

O.C36 

0.242 

-0.125 

C.P32 

-0. ICf 

-C.  142 

— C  .016 

-C.C09 

-0.C25 

l.CCO 

(131 

-0.324 

-0.274 

O.C46 

-0.274 

-C.Cf.6 

-C.4  33 

-0.332 

C.  126 

C.710 

0.721 

-0.666 

"  -0.5CI 

l.OCO 

e.-tir  ::c.  of 

'a'  VAPS,  Tix:: 

l(.L'&.\  V#f 

*r  vaf 

?<*!/( 

rr.cn.  nv 

r^’r-c. 

/'C  f  * 

•  r  c. 

..... 

.  .. 

B-2 


HTTL 


VAF. 

la:el 

mea:: 

STB-DEV 

t:t::  :jx 

1 

ecu 

6.6522 

4.C467 

2.0COCE  CO  1.6CCCC  01 

2 

PEC 

3. COCO 

1.C445 

2.CCC0E  CO  3.0C00E  CO 

3 

ms 

16. 

1733 

0.5762 

1.4CC0C  01  1.6C0QE  01 

4 

sc 

7. 

1304 

i.occe 

5.00C0E  CC  F.CCCOE  C C 

5 

ape:: 

4.i 

COCO 

3.1334 

l.OOOCE  90  t.COCOE  01 

6 

TJ 

it. 

6957 

17.1C7? 

3.CCCCE  a  :.;ccoc  oi 

7 

rr.s 

21. 

7732 

13.9395 

2.4C7CE  CC  7.61 7212  01 

r 

?FAI 

5. 

Cl  30 

6.52C3 

l.CCC CE  CC  2.CCCCE  Cl 

0 

OEl 

0. 

2257 

c.^oe 

1.O0CCE-02  9. 2CC0E-C1 

1C 

CE 

c. 

3713 

0.3443 

4.CCCCE-C2  1.27COC  CC 

a 

0*2 

6217 

0.5353 

l.CCCCE-Ol  1.75CCE  00 

12 

P?£0 

c. 

1504 

0*1306 

9.0C0CE-02  4.fCCCE-Cl 

12 

LCC 

0. 

152? 

0.4200 

-5.11P9E-C1  1.1C36E  00 

CCS?. 

m 

,  .‘  ATP.  IX 

CCRr.ELA.TIO"  : 

1ATEI.V 

(  u 

(  21 

(  31 

(  41 

(31  (61  (71 

(  ei 

C  91 

(  tci 

(  HI 

(  121 

t  131 

i  a 

t.CC-0 

(  2J 

-0.C99 

l.COO 

(  31 

c.6oe 

-=-0.151 

1.000 

t  41 

C.4C1 

-0.633 

0.106 

l.COO 

t  3/ 

-C.099 

l.COO 

-0.131 

-0.633 

l.COO 

(  «1 

0.141 

0.941 

-0.004 

-O.S53 

0.941-  l.OCO 

[  7) 

-0.2CF 

-0.176 

-0.144 

0.467 

-0.176  -0.22S  l.CC-0 

f  si 

i.ccc 

t  91 

-C.C-24 

-0.025 

0.143 

C.26S 

-0.025  -0.042  C.632 

0.C64 

l.COO 

0.172 

C.346 

-0.253 

0.172  0.170  -0.150 

5.470 

t'.CJ 

C.07C 

0.301 

0.310 

-0.401 

C.3C1  C.296  -0.35C 

C.3C4 

0.961 

-T.CGC 

(111 

0.062 

0.405 

0.244 

-0.301 

0.4C3  0.4C6  -0.491 

0.112 

C.S4C- 

'0.036 

'l.COO 

(121 

-0.1  C2 

C.939 

-0.049 

-0.F.29 

C.939  C.916  -2.372  • 

-0.143 

2.253 

C.4C2 

C.516 

l.CCC 

(13) 

C.C"t 

-0.162 

C.  354 

-0.C03 

-0.162  —C .165  -0.113 

0.346 

o.nc 

C.7SC 

'9.679 

-O.C92 

l.CCC 

ejte; 

■.  :c.  cr 

0 

B-3 


LSTTL 


VAR 

LAi  a 

src-crv 

::xr  :vc 

l 

cc:y 

3C.6I5S 

35.4034 

•  l.OOOCE  00  1.46CCE  C2 

2 

PKC 

3.236? 

0.8198 

3.000CE  CO  5.CCSCE  CO 

3 

SPIN 

15.6316 

2.0191 

1.4C0C-E  Cl  2.4fCC£  01 

4 

TJ 

46.2 

105 

3. 3064 

4.1C0CE  01  5.5CCJE  01 

3 

nr.s 

196.3143  357.3795 

6.200001  I.S517E  03 

$ 

?FAI 

26. £421 

52.7162 

l.OCCOE  CC  2.7SC0C  C2 

7 

cn 

O.IC29 

0.C833 

l.CCCCE-02  3..'CCCE-C1 

C 

oc 

0.1774 

0.2636 

3.0CC002  1.660CC  CC 

S 

OB  2 

0.32S2 

0.73CC 

6.0CCCE-02  4.75CCE  OC 

1C 

PP.EC 

C.1932 

0.0603 

l.ICCOE-Ot  3.6CCCC-OI 

11 

ICC 

-C.19C3 

0.3175 

-G.1292R-C1  6.63C12-C1 

COPR. 

M 

,  :»tsir 

corpeu; 

NATRIX 

[  U 

[  21 

[  3] 

[  4] 

t  Si  [61  [7) 

t  ?1 

1  si 

[  101 

t  HI 

1  1! 

l.CC-0 

[  21 

0.573 

1.000 

t  31 

0.317 

0.230 

l.OGO 

( ‘1 

0.79F 

0.507 

0.446* 

1.000 

t  51 

-0.326 

-0.157 

•0.267 

•0.277 

l.OCO 

t  61 

-0.3C6 

-0.145 

•0.243 

-0.238 

0.983  l.COO 

t  7] 

-0.C20 

0.117 

0.267 

0.169 

0.103  C.lf7  l.CCC 

(  8) 

0.205 

O.J32 

0.393 

0.439 

-0.066  -0.046  0.733 

l.CCO 

t  51 

0.249 

l.CCO 

0.612 

0.3??* 

0.479 

-0.12?  -0.1C3  0.373 

0.976 

tici 

0.913 

0.583 

0.621 

<.  0.906 

-0.373-  -0.346  0.124 

C.410 

0.454 

1.000 

dll 

-0.217 

0.114 

0.C65 

-0.052 

C.216  0.293  0.S95 

0.677 

C.532 

-0.104 

l.OCC 

ENTER  NO.  OF  *7,'  VARS,  TI.EH  INDEX  Cr  *Y'  VAP. 
FULIOI.TD  EY  ESDI 
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B-4 


STTL 


VAT 

utn. 

HEAT 

STC-OEV 

:.tr 

iU*. 

1 

co:t 

9C.9032 

384.8131 

l.CCCOE  00 

2.0480E  C3 

2 

ir.c 

3.0323 

1.2776 

t.OCCCE  00 

9.0C00E  00 

j 

IS.8C65 

2.6CC2 

1.4000E  n 

2.fOCOF.  01 

i 

sc 

7.4835 

1.2877 

2.ITCCE  CO 

O.CCOCC  00 

% 

apej: 

4.*?39 

2.C145 

3.CC0CE  00 

t.  score  ci 

« 

ZJ- 

61.34P*- 

18.0127 

•2.7ccci:  oi 

1.050CE  02 

7 

HSS 

65.«3C0 

100.6722 

1.48CCS-01 

3.5535E  02 

f 

*FAI 

12.7097 

10.2911 

i.cocr-E  cc 

7.irC0E  01 

0 

C21 

C.483P 

1.10*6 

l.f000E-C2 

3.57CCE  CO 

l* 

^3 

1.C613 

2.6077 

3.0000E-C2 

1.35CCC  n 

11 

C32 

2.1919 

3.3*31 

7.P00CC-O2 

2.r?00E  01 

12 

PPED 

C.3l*8 

0.2920 

5.0000C-C2 

1.53CCE  ro 

13 

ICC 

C. 1321 

0.4317 

-6.9207E-O.1 

1.12C9E  cr 

ccs*!.  lAirur 


CCf.fElATIO:!  laTJIT 


t  tl 

t  2] 

t  31 

(  4! 

t  31 

t  61 

t  7} 

t  81 

t  ?1 

(  101 

t  HI 

t  121 

t  13J 

1 

( 11 

l.COC 

j 

l  2] 

0.262 

l.CCO 

l  31 

0.030 

-c.ne 

l.CCO 

1  *1 

-C.5C7. 

-0.C3C 

•0.130 

1.000 

(  51 

0.699 

C.836* 

O.Olf 

-0.337 

1.000 

t  51 

0.473 

0.442* 

0.033 

-O.C43 

0.60* 

l.CCO 

(  21 

-0.156 

-O.C76 

-0.311 

0.210 

-0.162 

-C.297 

l.CCC 

t  ?1 

-0.123 

-0.051 

-0.247 

0.205 

-0.136' 

-0.255 

0.862 

l.OCC 

t  91 

C.39? 

i.rco 

0.720 

o.cts 

-0.273 

0.48C 

-0.2CC 

-0.129 

CIC1 

0.403 

0.837 

0.031 

-0.299 

0.853 

C.499 

-0.225 

-0.172 

0.989 

l.COO 

till 

C.401 

C.83S 

0.075 

-0.314 

0.903 

0.391 

-0.237 

-0.1  ?2 

C.974 

0.997* 

l.CCO 

j 

tl2J 

C.228 

C.67? 

0.193 

-C.IC7 

C.71C 

0.7C7 

-0.342 

-C  -276 

C.?42 

0.843 

O.S42 

•i.oco 

1 131 

0.382 

0.317 

0.091 

-C.334 

0.15* 

-C-.fC?* 

-*.;CE 

•0.023 

C.371 

0.561 

0.334. 

0.237 

l.CCO 

err*  re.  o 

VAR 

LAS  CL 

REAL' 

STO-CEV, 

::i:' 

LAX 

1 

CKT 

24.0433 

•1C.71R9 

2.CCCCC  CO 

6.5CCCE  01 

2 

pi:c  - 

2.9353 

0.3360 

2.CCC0E  OC 

f.COCCF.  00 

1 

13.4349 

2. 0939 

1.4C0CC 

2.4CCCE  Cl 

4 

sc 

7.9913 

0.3147 

7.r,r;ec£  CO 

E.CCCCs,  CO 

* 

* 

ape:. 

4.9595 

2.5176 

4.CCCCE  CC 

1.2CCCE  Cl 

5 

tj— 

43.1937 

6.4312 

3.1CCCE  01 

6. COCOS  Cl 

7 

HRS 

61.C664 

1C9.C7K 

1.122CE  CC 

5.74  24E  02 

H 

(?AZ 

21.6097 

36.2132 

l.CCCCt  CC 

1.C70CE  C2 

5 

CCl 

C.2909 

0.3072 

1.CCCCC-C2 

1.37CCE  CC 

1C 

c: 

C.4217 

0.4406 

6.C0CCE-02 

2.67CCE  CC 

11 

OS  2 

C.54CC 

0.7412 

l.CCOCE-Cl 

4.52C0E  CC 

12 

PRE2 

C. 1972 

0.1097 

l.ICCCO-Cl 

7.CC-CCE-C1 

13 

LCC 

G.2C96 

0.4227 

-7.5334S-01 

t.ri43E  CC 

CVRU. 

■ 

.  iiattl': 

coRJiUtrcj: : 

'AIRIS 

(  U 

t 

2]  {  3] 

I  41 

t  31  ( 

il  t  71 

t  91 

t 

ici  t  til 

t  121 

(  131 

(  U 

l.OCO 

t  21 

0.414* 

*  l.COC 

l  31 

0.4C1 

-O.C22  l.OCO 

t  41 

C.2P0 

0.607  -0.093 

1.000 

[  il 

-C.2C0 

-C.6C7  0.093 

-l.COC 

l.OCO 

t  «1 

0.142 

-0.314  0.3C? 

-0.649 

0.64? 

l.COO 

t  71 

-C.267 

C.031  -0.177 

C.17C 

-0.17C 

—0 . 1  f  1 

l.COC 

[  J1 

•0.234 

0.052  -0.203 

0.201 

-C.2CI 

-C.33?. 

0.917 

l 

t  51 

0-2fC 

l.OCO 

v.533  — C .01 2 

0.216 

-0.296 

-0.436 

o.r-20 

0 

tici 

C.37C 

0.703'  0.034 

0. 161 

-0.161 

-0.272 

•C  •  C$5 

0 

C.939- 

1.000 

(111 

0.390 

C-.71C*  0.116 

C.030 

-0.030 

•0.075 

-0. 167 

•C 

TTL 


VAR 

LAS  EL 

meats 

STC-CEV 

MIN 

LAX 

l 

COMP 

73.6326 

233.7596 

l.COOOE  CO 

2.C460E  03 

2 

PRC 

3.3695 

1.2969 

l.CCCCE  CO 

9.0C00E  00 

3 

MP  IK 

13.4103 

2.0602 

1.4000E  01 

2.4CCCC  01 

u 

SC 

6.7379 

1.6946 

l.CCCCE  OC 

6.CCCCE  00 

5 

A?Et: 

5.4421 

2.7472 

2.0CCCE  OC 

I.2000E  01 

6 

TJ 

62.6632 

17.9269 

3.CC0CE  01 

1.1SCGC  C2 

7 

HRS 

S3. 2171 

217.7419 

4.7400E-01 

l.cSScE  C3 

S 

mi 

1S.61CS 

41.1664 

i.occoe  qc 

3.23C0E  02 

9 

001 

0.2376 

0.2974 

l.CCOCE-C? 

1.9100E  00 

1C 

08 

0.4233 

0.5431 

4.00CCE-02 

3.33CCE  CO 

11 

012 

0.7964 

1.1742 

S.CCP0E“02 

6.32CCE  00 

12 

PRED 

0.3324 

0.3194 

4.CCCCC-02 

1.67C0E  00 

13 

LOC 

0.0431 

0.4323 

-9.63ECE-01 

1.C16CC  CO 

cor.r..  mm 


CORRELATION  t!ATRIX 


(  U 

t  21 

(  3] 

(  41 

(  3] 

(  61 

t  7J 

t  81 

C  91 

t  Id 

( 111 

I  121 

t  131 

l  U 

1.000 

t  21 

-0.172 

1.000 

(  31 

0.109 

0.198 

1.000 

t  4] 

-0.230 

-0.216 

•0.010 

1.000 

t  3J 

-0.070 

0.488" 

0.069 

-0.394 

1.000 

t  61 

0.029 

0.316 

0.393 

-0.38P 

0.776- 

l.COO 

[  71 

-0.061 

-0.108 

-0.133 

C.229 

-0.187 

-C.249 

l.OCO 

t  31 

-0.067 

-0.119 

-0.171 

0.263' 

-C.210 

-0.264 

0.974- 

l.COO 

t  91 

-0.023 

0.119 

-0.066 

•0.021 

0.161 

0.131 

-C.C62 

0.C14 

1.000 

ttei 

-0.032 

C.283 

•0.031 

-0.235 

0.357 

0.318' 

-C.143 

-0.102 

0.893 

t.COO 

tm 

-O.C39 

0.37E 

0.001 

•0.360 

■0.432- 

0.4C4- 

-C.173 

-C.1C2 

0.670 

0.931 

1.000 

1 1 21 

0.051 

0.447* 

0.498= 

-0.3C2* 

0.621 

0.747 

•*0.202 

-0.2 IS 

C.  148 

0.324 

0.413 

l.COC 

(131 

0.072 

-0.131 

-0.343' 

-C.CP2 

-C.246 

-0.27C 

C.C73 

0.163 

0.536 

0.493 

'0.400 

•0.413 

l.OCO 

ektet.  rc.  or 

*r  VAF. 

B-7 


ECL 


VAP 

LABEL 

5T2-0EV 

LIE  iJu* 

1 

CCJ.P 

20.6462 

53.6432 

2.CCCCE  00  2.560CE  C2 

2 

PKG 

2.6535 

0.5458 

2.C0CCE  00  6.0CCCE  CC 

3 

i:piu 

15.3846 

0.9414 

1.4C0CE  Cl  1.60C0L  Cl 

4 

sc 

7.4231 

0.5566 

4.CCC0C  CC  0. COL 05  CC 

5 

TJ 

60.73CS 
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TECHNOLOGY  -  5 
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RATIO  PLOT  #8:  LTTL  DATA  ON  JUNCTION  TEMPERATURE 
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TECHNOLOGY  -  6 
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RATIO  PLOT  #9:  TTL  DATA  ON  JUNCTION  TEMPERATURE 
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RATIO  PLOT  #  12:  SSI/MSI  MODEL 
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RATIO  PLOT  #13:  LSI /MICROPROCESSOR  MODEL 


APPENDIX  D 

MIL-HDBK-217C,  PART  III  UPDATE 


OICIIM.  UVICES  IK 
(f./10*  Uows) 


51*0  -<*t*4|0 


CESS  MEMMV  (MM) 
(E./10*  Nows) 


HBS  Oyualc  O.SS _ K/ _ _ <L1 _ ^0 _ O _ JL* _ M _ >■«  *•*  j 

HOS  Sutlc  1.4  _ il _ SJ _ il _ W _ K. _ IS. _ 5,»  »■ _ M _ | 


TABLE  3-8 


*Q,  QUALITY  FACTORS  FOR  USE  WITH 
TABLES  3-1  THRU  3-7 
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TABLE  3-9 

"l1  LEARNING  FACTOR  FOR  USE  WITH  TABLES 
3-1  THRU  3-7 

The  1  taming  factor  tl  is  1<?  under  any  of  the  following  conditions: 

(l)  New  device  in  initial  production. 

),{  f!Jere  changes  In  design  or  process  have  occurrmd 

m  &rrff,ss5,wfS2ffi?  "  ~  *  • 

3d  oJ’SU?  1,0  *"  conditions  not  sand  in  (1).  (2) 
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APPENDIX  E 
PARAMETRIC  CURVES 


Appendix  E  contains  graphs  of  predicted  failure  rate  as  a  function  of 
complexity  for  junction  temperatures  of  2S°C,  50°C,  75°C,  100OC  and  1250C. 
Failure  rate  calculations  are  based  on  the  microcircuit  reliability 
prediction  models  of  MJL-HDBK-217C  and  assume  a  part  which  has  bc?n 
screened  to  Class  B  specifications,  used  in  a  ground-fixed  (GF)  environment 
and  in  a  ceramic  dual-in-line  (OIP)  package  with  glass  seal. 

These  graphs  permit  the  reader  to  visualize  the  effects  of  complexity 
and  temperature  on  predicted  failure  rate  for  various  part  types  and 
technologies.  The  graphs  are  also  useful  for  estimating  the  predicted 
reliability  of  alternative  components  during  the  early  design  and  component 
selection  stages. 
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FIGURE  7:  NMOS  LSI  RANDOM  LOGIC 
ASSUMES  CLASS  B  PART,  40-PIN  CERDIP,  GF  ENVIRONMENT 
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FIGURE  9:  CMOS  LSI  RANDOM  LOGIC 


assumes  CLASS  B  part.  40-pin  ceadip,  sf  environment 
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FIGURE  11:  NMOS  DYNAMIC  RAM 
ASSUMES  CLASS  B  PART,  16-PIN  CERDIP,  GF  ENVIRONMENT 
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FIGURE  12:  BIPOLAR  ROM 

ASSUMES  CLASS  B  PART,  24-PIN  CERDIP,  GF  ENVIRONMENT 
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